Network-assisted fabric pairing

ABSTRACT

Systems and methods for joining a device to a fabric using an assisting device include an indication to add a joining device to a fabric. If the joining device supports network-assisted fabric pairing, a first connection is established between a commissioning device and the assisting device. The assisting device also connects to a joining device. Through the assisting device, the commissioning device and the joining device establish a communication channel over which fabric credentials may be sent.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of Provisional Application Ser. No.62/061,593, filed Oct. 8, 2014, entitled “FABRIC NETWORK,” which isincorporated by reference herein in its entirety.

BACKGROUND OF THE DISCLOSURE

This disclosure relates to systems, devices, methods, and relatedcomputer program products for smart buildings including the smart home.More particularly, this patent specification relates to adding devicesto a preexisting fabric using devices already residing on the network.

Some homes today are equipped with smart home networks to provideautomated control of devices, appliances and systems, such as heating,ventilation, and air conditioning (“HVAC”) systems, lighting systems,alarm systems, and home theater and entertainment systems. Smart homefabrics may include one or more networks of devices interconnected toautomation functions within the home. For example, a person may input adesired temperature and a schedule indicating when the person is awayfrom home.

In some scenarios, it may be desirable to add new devices to thenetworks and/or fabrics in the smart home. However, in some scenarios,the devices being added have limited connectivity before being connectedto other devices. For example, some joining devices may join to devicesthat are manually set to a network created by the joining devices. Forexample, a smartphone may be manually set to connect to the joiningdevice on a WiFi network generated by the joining device. However, suchmanual setting of connecting networks use interactions with users thatmay decrease user experience and/or increase complexity of the pairingprocess.

BRIEF SUMMARY OF THE DISCLOSURE

A summary of certain embodiments disclosed herein is set forth below. Itshould be understood that these aspects are presented merely to providethe reader with a brief summary of these certain embodiments and thatthese aspects are not intended to limit the scope of this disclosure.Indeed, this disclosure may encompass a variety of aspects that may notbe set forth below.

Embodiments of the present disclosure provide methods and systems forenabling devices to join devices to network and/or fabrics consisting ofseveral networks and adding the devices to the network and/or fabrics.In some embodiments, these devices may be joined to a network byconnecting to another device (e.g., smartphone) by having the otherdevice change networks to a network hosted by the joining device.However, in such embodiments, the other device has to change networks,which may be tedious, annoying, and/or inefficient process that reducespossible automation of the joining process.

BRIEF DESCRIPTION OF THE DRAWINGS

Various aspects of this disclosure may be better understood upon readingthe following detailed description and upon reference to the drawings inwhich:

FIG. 1 illustrates an embodiment of a smart-home environment withinwhich one or more of the devices, methods, systems, services, and/orcomputer program products described herein may be used, according to anembodiment;

FIG. 2 illustrates a network-level view of an extensible devices andservices platform with which the smart-home environment of FIG. 1 can beintegrated, according to an embodiment;

FIG. 3 illustrates a functional view of the extensible devices andservices platform of FIG. 2, with reference to a processing engine aswell as devices of the smart-home environment, according to anembodiment;

FIG. 4 illustrates block diagram view of a smart device that maysecurely communicate with other smart devices within the smart-homeenvironment, according to an embodiment;

FIG. 5 illustrates a schematic view of devices interconnected within thesmart-home environment, according to an embodiment;

FIG. 6 illustrates a model view that illustrates functions of acommunication system in layers including an application layer, atransport layer, and a network layer, according to an embodiment;

FIG. 7 illustrates an exchange of information between devices, with atleast one device being part of the smart-home environment, according toan embodiment;

FIG. 8 illustrates a schematic view of a network-assisted fabricprovisioning using an assisting device and a commissioner, according toan embodiment;

FIGS. 9A-9C illustrates a flowchart view of a process for updating thedevice of FIG. 8 using the commissioner and assisting device of FIG. 8,according to an embodiment;

FIG. 11 illustrates a protocol sequence diagram view of a resetconfiguration interaction, according to an embodiment;

FIG. 12 illustrates a protocol sequence diagram view of an new armfailsafe interaction, according to an embodiment;

FIG. 13 illustrates a protocol sequence diagram view of a reset armfailsafe interaction, according to an embodiment;

FIG. 14 illustrates a protocol sequence diagram view of a resume armfailsafe interaction, according to an embodiment;

FIG. 15 illustrates a protocol sequence diagram view of a disarmfailsafe interaction, according to an embodiment;

FIG. 16 illustrates a protocol sequence diagram view of an enableconnection monitor interaction, according to an embodiment;

FIG. 17 illustrates a protocol sequence diagram view of a remote passiverendezvous interaction, according to an embodiment;

FIG. 18 illustrates a schematic view of a reset configuration dataframe, according to an embodiment;

FIG. 19 illustrates a schematic view of an arm failsafe data frame,according to an embodiment;

FIG. 20 illustrates a schematic view of an enable connection monitordata frame, according to an embodiment; and

FIG. 21 illustrates a schematic view of a remote passive rendezvousrequest data frame, according to an embodiment.

DETAILED DESCRIPTION OF THE DISCLOSURE

One or more specific embodiments of the present disclosure will bedescribed below. These described embodiments are only examples of thepresently disclosed techniques. Additionally, in an effort to provide aconcise description of these embodiments, all features of an actualimplementation may not be described in the specification. It should beappreciated that in the development of any such actual implementation,as in any engineering or design project, numerousimplementation-specific decisions must be made to achieve thedevelopers' specific goals, such as compliance with system-related andbusiness-related constraints, which may vary from one implementation toanother. Moreover, it should be appreciated that such a developmenteffort might be complex and time consuming, but may nevertheless be aroutine undertaking of design, fabrication, and manufacture for those ofordinary skill having the benefit of this disclosure.

When introducing elements of various embodiments of the presentdisclosure, the articles “a,” “an,” and “the” are intended to mean thatthere are one or more of the elements. The terms “comprising,”“including,” and “having” are intended to be inclusive and mean thatthere may be additional elements other than the listed elements.Additionally, it should be understood that references to “oneembodiment” or “an embodiment” of the present disclosure are notintended to be interpreted as excluding the existence of additionalembodiments that also incorporate the recited features.

Embodiments of the present disclosure generally relate tonetwork-assisted fabric pairing of devices using a network to as anextension of a fabric-pairing infrastructure to provide simplifiedpairing of additional devices to the fabric using the network. In short,a fabric device joining a network which supports network-assistedpairing may be able to form a connection via the network with a fabricdevice currently paired to the fabric when the fabric device supportsnetwork-assisted pairing. Using this connection, the joining device mayreceive network provisioning information and/or other information overthis connection. Enabling the user to add devices within a singlenetwork provides a simplified in-band pairing mechanism that allowsdevices to be paired to a fabric without manually switching networks(e.g., WiFi) on a device thereby reducing or eliminating userinteraction used to join the joining device to the fabric. Thismechanism may be particularly advantageous when the joining device isnot capable of automatically switching between networks in response tothird-party instructions used to commission additional fabric devices.In other words, if the joining device is a hazard-detection device thatincludes a version of software that does not enable the device to switchWiFi network connections based on commands from a smartphone withoutcausing the smartphone to join the device's own WiFi network, the devicemay instead connect to a different device already paired to a fabricusing a network connection.

Terminology

As used herein, network refers to a data network communication that iswireless or wired in character. For example, the network may include an802.15.4 network, an 802.11 network, or other suitable network types forcommunicatively coupling two or more devices. A fabric is a group ofpaired devices or nodes, which can communicate with each other securelywithout a connection to the cloud service. In some embodiments, allnodes on the same fabric belong to the same structure and are paired tothe same account. A fabric structure is the physical environment inwhich a fabric-enabled product is installed (e.g., a home or apartment).In some embodiments, a structure may only contain at most one fabric. Afabric pairing process is the method by which a new device receivesnetwork provisioning information, joins or creates its structure'sfabric, and pairs with its user's account via a service. In someembodiments, the fabric pairing process is performed completely usingfabric protocol interactions. Network provisioning is the process bywhich a fabric device receives the information used to join the networkspresent in its structure. In some embodiments, this process is performedprior to fabric joining. Fabric joining is the process by which a deviceis provisioned with information used to securely communicate with othernodes on an existing fabric. In some embodiments, fabric joining isperformed after network provisioning and before account pairing. Serviceprovisioning and account pairing is the process by which a device isregistered to an account via a cloud service. In some embodiments, theaccount pairing enables the user to remotely interact with the device,such as a remote interaction using a mobile device application. In someembodiments, the account pairing and service provisioning process alsoincludes provisioning any information into the device that may be usedto identify, authenticate, and connect to the service.

Additional device pairing is a fabric pairing process where a new deviceis installed in a structure with an existing fabric. In this case,devices on the existing fabric may assist in the pairing process toreduce the amount of user interaction to simplify the process from theuser perspective. In some embodiments, some of the devices on theexisting fabric may sleepy devices that periodically enter a low powerstate. In such embodiments, at least one device on the existing fabricis awake during this process for the new device to automatically receivenetwork and fabric provisioning information from the devices already onthe existing fabric. Thus, in some embodiments, the process may bedelayed if no devices are awake. In other embodiments, the joiningdevice, a service, or some other device may awaken at least one of thedevices already on the existing network from a lower power state toinitiate the pairing process.

As used herein, the device joining the network may be referred to as thejoining device. Also, as used herein, a fabric commissioner is a devicethat orchestrates the fabric pairing process for the joining device viathe fabric profiles for network, fabric, and service provisioning. Insome embodiments, the commissioner may include a smart device (e.g.,phone or tablet), computer, a device already on the fabric, or someother device that may be used to control and orchestrate the joiningprocess. As used herein, an assisting device refers to an existing,paired fabric device that assists the joining device in the pairingprocess to reduce the amount of user interaction.

It should be appreciated that “smart home environments” may refer tosmart environments or smart networks for any building type, such assingle-family houses, duplexes, townhomes, multi-unit apartmentbuildings, hotels, retail stores, office buildings, industrialbuildings, and any building that may include one or more smart devices.

It is to be further appreciated that while the terms user, customer,installer, homeowner, occupant, guest, tenant, landlord, repair person,user, and similar terms may be used to refer to a person or personsinteracting with a smart device within the network via a user interface,these references are by no means to be considered as limiting the scopeof the present teachings with respect to the person or persons who areperforming such actions. Thus, for example, the terms user, customer,purchaser, installer, subscriber, and homeowner may often refer to thesame person in the case of a single-family residential dwelling, becausethe head of the household is often the person who makes the purchasingdecision, buys the unit, and installs and configures the units, and isalso one of the users of the units. However, in other scenarios, such asa landlord-tenant environment, the customer may be the landlord withrespect to purchasing the unit, the installer may be a local apartmentsupervisor, a first user may be the tenant, and a second user may againbe the landlord with respect to remote control functionality. While theidentity of the person performing the action may be germane to aparticular advantage provided by one or more of the embodiments—forexample, the password-protected network commissioning functionalitydescribed herein may be particularly advantageous where the landlordholds the sole password and can control network additions—such identityshould not be construed in the descriptions that follow as necessarilylimiting the scope of the present teachings to those particularindividuals having those particular identities.

Smart Network

With the foregoing in mind, FIG. 1 illustrates an example of asmart-home environment 100, also referred to as a smart network, withinwhich one or more of the devices, methods, systems, services, and/orcomputer program products described further herein can be applicable.The depicted smart-home environment 100 includes a structure 150, whichcan include, e.g., a house, office building, garage, or mobile home. Insome embodiments, the devices can also be integrated into a smart-homeenvironment 100 that does not include an entire structure 150, such asan apartment, condominium, or office space. Further, the smart homeenvironment can control and/or be coupled to devices outside of theactual structure 150. Indeed, several devices in the smart homeenvironment need not physically be within the structure 150 at all. Forexample, a device controlling a pool heater or irrigation system can belocated outside of the structure 150.

The depicted structure 150 includes multiple rooms 152, separated atleast partly from each other via walls 154. The walls 154 can includeinterior walls or exterior walls. Each room can further include a floor156 and a ceiling 158. Devices can be mounted on, integrated with and/orsupported by a wall 154, floor 156 or ceiling 158.

In some embodiments, the smart-home environment 100 of FIG. 1 includesvarious devices, including intelligent, multi-sensing, network-connecteddevices that may integrate seamlessly with each other, with a centralserver, with a cloud-computing system, or some combination of these toprovide any of a variety of useful smart-home objectives. The smart-homeenvironment 100 may include one or more intelligent, multi-sensing,network-connected thermostats 102 (hereinafter referred to as “smartthermostats 102”), one or more intelligent, network-connected,multi-sensing hazard detection units 104 (hereinafter referred to as“smart hazard detectors 104”), one or more intelligent, multi-sensing,network-connected doorbell devices 106 (hereinafter referred to as“smart doorbells 106”), and one or more intelligent, network-connecteddoor locks 107 (hereinafter referred to as “smart door locks 107”).According to embodiments, the smart thermostat 102 detects ambientclimate characteristics (e.g., temperature and/or humidity) and controlsa HVAC system 103 accordingly. The smart hazard detector 104 may detectthe presence of a hazardous substance or a substance indicative of ahazardous substance (e.g., smoke, fire, or carbon monoxide). The smartdoorbell 106 may detect a person's approach to or departure from alocation (e.g., an outer door), control doorbell functionality, announcea person's approach or departure via audio or visual means, or controlsettings on a security system (e.g., to activate or deactivate thesecurity system when occupants go and come). The smart door locks 107may detect and toggle between a locked and unlocked condition for doorsin the home, detect a person's approach to or departure from arespective door, detect whether a door is open or closed, or othersuitable controls associated with a smart door lock.

In some embodiments, the smart-home environment 100 of FIG. 1 furtherincludes one or more intelligent, multi-sensing, network-connected wallswitches 108 (hereinafter referred to as “smart wall switches 108”),along with one or more intelligent, multi-sensing, network-connectedwall plug interfaces 110 (hereinafter referred to as “smart wall plugs110”). The smart wall switches 108 may detect ambient lightingconditions, detect room-occupancy states, and control a power and/or dimstate of one or more lights. In some instances, smart wall switches 108may also control a power state or speed of a fan, such as a ceiling fan.The smart wall plugs 110 may detect occupancy of a room or enclosure andcontrol supply of power to one or more wall plugs (e.g., such that poweris not supplied to the plug if nobody is at home).

Further, in some embodiments, the smart-home environment 100 of FIG. 1includes multiple intelligent, multi-sensing, network-connectedappliances 112 (hereinafter referred to as “smart appliances 112”), suchas refrigerators, stoves and/or ovens, televisions, washers, dryers,lights, stereos, intercom systems, garage-door openers, floor fans,ceiling fans, wall air conditioners, pool heaters, irrigation systems,security systems, window sensors, security systems, and so forth.According to embodiments, the network-connected appliances 112 may bemade compatible with the smart-home environment by cooperating with therespective manufacturers of the appliances. For example, the appliancescan be space heaters, window AC units, motorized duct vents, etc. Whenplugged in, an appliance can announce itself to the smart-home network,such as by indicating what type of appliance it is, and it canautomatically integrate with the controls of the smart-home. Suchcommunication by the appliance to the smart home can be facilitated byany wired or wireless communication protocols known by those havingordinary skill in the art. The smart home also can include a variety ofnon-communicating legacy appliances 140, such as old conventionalwasher/dryers, refrigerators, and the like which can be controlled,albeit coarsely (ON/OFF), by virtue of the smart wall plugs 110. Thesmart-home environment 100 can further include a variety of partiallycommunicating legacy appliances 142, such as infrared (“IR”) controlledwall air conditioners or other IR-controlled devices, which can becontrolled by IR signals provided by the smart hazard detectors 104 orthe smart wall switches 108.

According to embodiments, the smart thermostats 102, the smart hazarddetectors 104, the smart doorbells 106, the smart door lock 107, thesmart wall switches 108, the smart wall plugs 110, and other devices ofthe smart-home environment 100 may be modular and may be incorporatedinto older and new houses. For example, in some embodiments, the devicesare designed around a modular platform consisting of two basiccomponents: a head unit and a back plate, also referred to as a dockingstation. Multiple configurations of the docking station are provided soas to be compatible with any home, such as older and newer homes.However, all of the docking stations include a standard head-connectionarrangement, such that any head unit can be removably attached to anydocking station. Thus, in some embodiments, the docking stations areinterfaces that serve as physical connections to the structure and thevoltage wiring of the homes, and the interchangeable head units containall of the sensors, processors, user interfaces, the batteries, andother functional components of the devices.

Many different commercial and functional possibilities for provisioning,maintenance, and upgrade are possible. For example, after years of usingany particular head unit, a user may be able to buy a new version of thehead unit and simply plug it into the old docking station. There arealso many different versions for the head units, such as low-costversions with few features, and then a progression ofincreasingly-capable versions, up to and including sophisticated headunits with a large number of features. Thus, it should be appreciatedthat the various versions of the head units may be interchangeable, withany of them working when placed into any docking station. This canadvantageously encourage sharing and re-deployment of old head units—forexample, when an important high-capability head unit, such as a hazarddetector, is replaced by a new version of the head unit, then the oldhead unit can be re-deployed to a backroom or basement, etc. Accordingto embodiments, when first plugged into a docking station, the head unitcan ask the user (by 2D LCD display, 2D/3D holographic projection, voiceinteraction, etc.) a few simple questions such as, “Where am I” and theuser can indicate “living room,” “kitchen,” and so forth.

The smart-home environment 100 may also include communication withdevices outside of the physical home but within a proximate geographicalrange of the home. For example, the smart-home environment 100 mayinclude a pool heater monitor 114 that communicates a current pooltemperature to other devices within the smart-home environment 100 orreceives commands for controlling the pool temperature. Similarly, thesmart-home environment 100 may include an irrigation monitor 116 thatcommunicates information regarding irrigation systems within thesmart-home environment 100 and/or receives control information forcontrolling such irrigation systems. According to embodiments, analgorithm is provided for considering the geographic location of thesmart-home environment 100, such as based on the zip code or geographiccoordinates of the home. The geographic information then may be used toobtain data helpful for determining optimal times for watering. Suchdata may include sun location information, temperature, dew point, soiltype of the land on which the home is located, etc.

By virtue of network connectivity, one or more of the smart-home devicesof FIG. 1 can also enable a user to interact with the device even if theuser is not proximate to the device. For example, a user can communicatewith a device using a computer (e.g., a desktop computer, laptopcomputer, or tablet) or other portable electronic device (e.g., asmartphone) 166. A webpage or app can be configured to receivecommunications from the user and control the device based on thecommunications and/or to present information about the device'soperation to the user. For example, the user can view a current setpointtemperature for a device and adjust it using a computer. The user can bein the structure during this remote communication or outside thestructure.

As discussed, users can control the smart thermostat and other smartdevices in the smart-home environment 100 using a network-connectedcomputer or portable electronic device 166. In some embodiments, thedevice 166 may be connected to the smart network directly or throughadditional networks (e.g., WiFi) that are connected to the smart networkusing one or more devices (e.g., an edge router). In some examples, someor all of the occupants (e.g., individuals who live in the home) canregister their device 166 with the smart-home environment 100. Suchregistration can be made at a central server to authenticate theoccupant and/or the device as being associated with the home and to givepermission to the occupant to use the device to control the smartdevices in the home. An occupant may use their registered device 166 toremotely control the smart devices of the home, such as when theoccupant is at work or on vacation. The occupant may also use theirregistered device to control the smart devices when the occupant isactually located inside the home, such as when the occupant is sittingon a couch inside the home. It should be appreciated that instead of orin addition to registering devices 166, the smart-home environment 100may make inferences about which individuals live in the home and aretherefore occupants and which devices 166 are associated with thoseindividuals. As such, the smart-home environment “learns” who is anoccupant and permits the devices 166 associated with those individualsto control the smart devices of the home.

In some instances, guests desire to control the smart devices. Forexample, the smart-home environment may receive communication from anunregistered mobile device of an individual inside of the home, wheresaid individual is not recognized as an occupant of the home. Forexample, a smart-home environment may receive communication from amobile device of an individual who is known to be or who is registeredas a guest or determined to be on a common network (e.g., SSID WiFinetwork) as the smart devices.

In some embodiments, in addition to containing processing and sensingcapabilities, each of the devices 102, 104, 106, 107, 108, 110, 112,114, 116, 162, 170 and other smart devices (collectively referred to as“the smart devices”) may be capable of data communications andinformation sharing with any other of the smart devices, as well as toany central server or cloud-computing system or any other device that isnetwork-connected anywhere in the world. The required datacommunications can be carried out using any of a variety of custom orstandard wireless protocols (Wi-Fi, ZigBee, 6LoWPAN, etc.) and/or any ofa variety of custom or standard wired protocols (CAT6 Ethernet,HomePlug, etc.).

According to embodiments, all or some of the smart devices can serve aswireless or wired repeaters. For example, a first one of the smartdevices can communicate with a second one of the smart device via awireless router 160. The smart devices can further communicate with eachother via a connection to a network, such as the Internet 162. Throughthe Internet 162, the smart devices can communicate with a centralserver or a cloud-computing system 164. The central server orcloud-computing system 164 can be associated with a manufacturer,support entity, or service provider associated with the device. For someembodiments, a user may be able to contact customer support using adevice itself rather than needing to use other communication means suchas a telephone or Internet-connected computer. Further, software updatescan be automatically sent from the central server or cloud-computingsystem 164 to the smart devices (e.g., when available, when purchased,or at routine intervals).

As discussed below, the smart devices may be combined to create a meshnetwork. In some embodiments, this mesh network may include spokesmanand low-power nodes in the smart-home environment 100, where some of thesmart devices are “spokesman” nodes and others are “low-powered” nodes.Some of the smart devices in the smart-home environment 100 are batterypowered, while others have a regular and reliable power source, such asby connecting to wiring (e.g., to 120V line voltage wires) behind thewalls 154 of the smart-home environment. The smart devices that have aregular and reliable power source are referred to as “spokesman” nodes.These nodes are equipped with the capability of using any wirelessprotocol or manner to facilitate bidirectional communication with any ofa variety of other devices in the smart-home environment 100 as well aswith the central server or cloud-computing system 164. On the otherhand, the devices that are battery powered are referred to as“low-power” nodes. These nodes tend to be smaller than spokesman nodesand may communicate using wireless protocols that requires very littlepower, such as ZigBee, 6LoWPAN, etc. Furthermore, some low-power nodesmay also have a relatively low amount of memory to reduce powerconsumption. Thus, in some embodiments, these low-power nodes utilizestreamlined messages and data formats of data. Further, some, but notall, low-power nodes are incapable of bidirectional communication. Theselow-power nodes send messages, but they are unable to “listen”. Thus,other devices in the smart-home environment 100, such as the spokesmannodes, cannot send information to these low-power listening-only nodes.

As described, the smart devices serve as low-power and spokesman nodesto create a mesh network in the smart-home environment 100. Individuallow-power nodes in the smart-home environment regularly send outmessages regarding what they are sensing, and the other low-powerednodes in the smart-home environment—in addition to sending out their ownmessages—repeat the messages, thereby causing the messages to travelfrom node to node (i.e., device to device) throughout the smart-homeenvironment 100. The spokesman nodes in the smart-home environment 100are able to “drop down” to low-powered communication protocols toreceive these messages, translate the messages to other communicationprotocols, and send the translated messages to other spokesman nodesand/or the central server or cloud-computing system 164. Thus, thelow-powered nodes using low-power communication protocols are able tosend messages across the entire smart-home environment 100 as well asover the Internet 162 to the central server or cloud-computing system164. According to embodiments, the mesh network enables the centralserver or cloud-computing system 164 to regularly receive data from allof the smart devices in the home, make inferences based on the data, andsend commands back to one of the smart devices to accomplish some of thesmart-home objectives described herein.

As described, the spokesman nodes and some of the low-powered nodes arecapable of “listening”. Accordingly, users, other devices, and thecentral server or cloud-computing system 164 can communicate controls tothe low-powered nodes. For example, a user can use the portableelectronic device (e.g., a smartphone) 166 to send commands over theInternet to the central server or cloud-computing system 164, which thenrelays the commands to the spokesman nodes in the smart-home environment100. The spokesman nodes drop down to a low-power protocol tocommunicate the commands to the low-power nodes throughout thesmart-home environment, as well as to other spokesman nodes that did notreceive the commands directly from the central server or cloud-computingsystem 164.

An example of a low-power node is a smart nightlight 170. In addition tohousing a light source, the smart nightlight 170 houses an occupancysensor, such as an ultrasonic or passive IR sensor, and an ambient lightsensor, such as a photoresistor or a single-pixel sensor that measureslight in the room. In some embodiments, the smart nightlight 170 isconfigured to activate the light source when its ambient light sensordetects that the room is dark and when its occupancy sensor detects thatsomeone is in the room. In other embodiments, the smart nightlight 170is simply configured to activate the light source when its ambient lightsensor detects that the room is dark. Further, according to someembodiments, the smart nightlight 170 includes a low-power wirelesscommunication chip (e.g., ZigBee chip) that regularly sends out messagesregarding the occupancy of the room and the amount of light in the room,including instantaneous messages coincident with the occupancy sensordetecting the presence of a person in the room. As mentioned above,these messages may be sent wirelessly, using the mesh network, from nodeto node (i.e., smart device to smart device) within the smart-homeenvironment 100 as well as over the Internet 162 to the central serveror cloud-computing system 164.

Other examples of low-powered nodes include battery-operated versions ofthe smart hazard detectors 104. These smart hazard detectors 104 areoften located in an area without access to constant and reliable powerand, as discussed in detail below, may include any number and type ofsensors, such as smoke/fire/heat sensors, carbon monoxide/dioxidesensors, occupancy/motion sensors, ambient light sensors, temperaturesensors, humidity sensors, and the like. Furthermore, smart hazarddetectors 104 can send messages that correspond to each of therespective sensors to the other devices and the central server orcloud-computing system 164, such as by using the mesh network asdescribed above.

Examples of spokesman nodes include smart doorbells 106, smartthermostats 102, smart wall switches 108, and smart wall plugs 110.These devices 102, 106, 108, and 110 are often located near andconnected to a reliable power source, and therefore can include morepower-consuming components, such as one or more communication chipscapable of bidirectional communication in any variety of protocols.

In some embodiments, these low-powered and spokesman nodes (e.g.,devices 102, 104, 106, 107, 108, 110, 112, and 170) may function as“tripwires” for an alarm system in the smart-home environment. Forexample, in the event a perpetrator circumvents detection by alarmsensors located at windows, doors, and other entry points of thesmart-home environment 100, the alarm could be triggered upon receivingan occupancy, motion, heat, sound, etc. message from one or more of thelow-powered and spokesman nodes in the mesh network. For example, uponreceiving a message from a smart nightlight 170 indicating the presenceof a person, the central server or cloud-computing system 164 or someother device could trigger an alarm, provided the alarm is armed at thetime of detection. Thus, the alarm system could be enhanced by variouslow-powered and spokesman nodes located throughout the smart-homeenvironment 100. In this example, a user could enhance the security ofthe smart-home environment 100 by buying and installing extra smartnightlights 170.

In some embodiments, the mesh network can be used to automatically turnon and off lights as a person transitions from room to room. Forexample, the low-powered and spokesman nodes (e.g., devices 102, 104,106, 107, 108, 110, 112, and 170) detect the person's movement throughthe smart-home environment and communicate corresponding messagesthrough the mesh network. Using the messages that indicate which roomsare occupied, the central server or cloud-computing system 164 or someother device activates and deactivates the smart wall switches 108 toautomatically provide light as the person moves from room to room in thesmart-home environment 100. Further, users may provide pre-configurationinformation that indicates which smart wall plugs 110 provide power tolamps and other light sources, such as the smart nightlight 170.Alternatively, this mapping of light sources to wall plugs 110 can bedone automatically (e.g., the smart wall plugs 110 detect when a lightsource is plugged into it, and it sends a corresponding message to thecentral server or cloud-computing system 164). Using this mappinginformation in combination with messages that indicate which rooms areoccupied, the central server or cloud-computing system 164 or some otherdevice activates and deactivates the smart wall plugs 110 that providepower to lamps and other light sources so as to track the person'smovement and provide light as the person moves from room to room.

In some embodiments, the mesh network of low-powered and spokesman nodescan be used to provide exit lighting in the event of an emergency or anemergency drill. In some instances, to facilitate this, users providepre-configuration information that indicates exit routes in thesmart-home environment 100. For example, for each room in the house, theuser may provide a map of the best exit route depending on availabilityof the route. In some situations the route may be blocked by a hazard,and an alternate route may be illuminated and indicated, if available.It should be appreciated that instead of a user providing thisinformation, the central server or cloud-computing system 164 or someother device could automatically determine the routes using uploadedmaps, diagrams, architectural drawings of the smart-home house, as wellas using a map generated based on positional information obtained fromthe nodes of the mesh network (e.g., positional information from thedevices is used to construct a map of the house). In operation, when analarm is activated (e.g., when one or more of the smart hazard detector104 detects smoke and activates an alarm), the central server orcloud-computing system 164 or some other device uses occupancyinformation obtained from the low-powered and spokesman nodes todetermine which rooms are occupied and then turns on lights (e.g.,nightlights 170, wall switches 108, wall plugs 110 that power lamps,etc.) along the exit routes from the occupied rooms so as to provideemergency exit lighting.

Also included and illustrated in the smart-home environment 100 of FIG.1 are service robots 162 each configured to carry out, in an autonomousmanner, any of a variety of household tasks. For some embodiments, theservice robots 162 can be respectively configured to perform floorsweeping, floor washing, etc. in a manner similar to that of knowncommercially available devices such as the ROOMBA™ and SCOOBA™ productssold by iRobot, Inc. of Bedford, Mass. Tasks such as floor sweeping andfloor washing can be considered as “away” or “while-away” tasks forpurposes of the instant description, as it is generally more desirablefor these tasks to be performed when the occupants are not present. Forother embodiments, one or more of the service robots 162 are configuredto perform tasks such as playing music for an occupant, serving as alocalized thermostat for an occupant, serving as a localized airmonitor/purifier for an occupant, serving as a localized baby monitor,serving as a localized hazard detector for an occupant, and so forth, itbeing generally more desirable for such tasks to be carried out in theimmediate presence of the human occupant. For purposes of the instantdescription, such tasks can be considered as “human-facing” or“human-centric” tasks.

When serving as a localized thermostat for an occupant, a particular oneof the service robots 162 can be considered to be facilitating what canbe called a “personal comfort-area network” for the occupant, with theobjective being to keep the occupant's immediate space at a comfortabletemperature wherever that occupant may be located in the home. This canbe contrasted with conventional wall-mounted room thermostats, whichhave the more attenuated objective of keeping a statically-definedstructural space at a comfortable temperature. According to oneembodiment, the localized-thermostat service robot 162 is configured tomove itself into the immediate presence (e.g., within five feet) of aparticular occupant who has settled into a particular location in thehome (e.g. in the dining room to eat their breakfast and read the news).The localized-thermostat service robot 162 includes a temperaturesensor, a processor, and wireless communication components configuredsuch that control communications with the HVAC system, either directlyor through a wall-mounted wirelessly communicating thermostat coupled tothe HVAC system, are maintained and such that the temperature in theimmediate vicinity of the occupant is maintained at their desired level.If the occupant then moves and settles into another location (e.g. tothe living room couch to watch television), the localized-thermostatservice robot 162 proceeds to move and park itself next to the couch andkeep that particular immediate space at a comfortable temperature.

Technologies by which the localized-thermostat service robot 162 (and/orthe larger smart-home system of FIG. 1) can identify and locate theoccupant whose personal-area space is to be kept at a comfortabletemperature can include, but are not limited to, RFID sensing (e.g.,person having an RFID bracelet, RFID necklace, or RFID key fob),synthetic vision techniques (e.g., video cameras and face recognitionprocessors), audio techniques (e.g., voice, sound pattern, vibrationpattern recognition), ultrasound sensing/imaging techniques, andinfrared or near-field communication (NFC) techniques (e.g., personwearing an infrared or NFC-capable smartphone), along with rules-basedinference engines or artificial intelligence techniques that draw usefulconclusions from the sensed information (e.g., if there is only a singleoccupant present in the home, then that is the person whose immediatespace should be kept at a comfortable temperature, and the selection ofthe desired comfortable temperature should correspond to that occupant'sparticular stored profile).

When serving as a localized air monitor/purifier for an occupant, aparticular service robot 162 can be considered to be facilitating whatcan be called a “personal health-area network” for the occupant, withthe objective being to keep the air quality in the occupant's immediatespace at healthy levels. Alternatively or in conjunction therewith,other health-related functions can be provided, such as monitoring thetemperature or heart rate of the occupant (e.g., using finely remotesensors, near-field communication with on-person monitors, etc.). Whenserving as a localized hazard detector for an occupant, a particularservice robot 162 can be considered to be facilitating what can becalled a “personal safety-area network” for the occupant, with theobjective being to ensure there is no excessive carbon monoxide, smoke,fire, etc., in the immediate space of the occupant. Methods analogous tothose described above for personal comfort-area networks in terms ofoccupant identifying and tracking are likewise applicable for personalhealth-area network and personal safety-area network embodiments.

According to some embodiments, the above-referenced facilitation ofpersonal comfort-area networks, personal health-area networks, personalsafety-area networks, and/or other such human-facing functionalities ofthe service robots 162, are further enhanced by logical integration withother smart sensors in the home according to rules-based inferencingtechniques or artificial intelligence techniques for achieving betterperformance of those human-facing functionalities and/or for achievingthose goals in energy-conserving or other resource-conserving ways.Thus, for one embodiment relating to personal health-area networks, theair monitor/purifier service robot 162 can be configured to detectwhether a household pet is moving toward the currently settled locationof the occupant (e.g., using on-board sensors and/or by datacommunications with other smart-home sensors along with rules-basedinferencing/artificial intelligence techniques), and if so, the airpurifying rate is immediately increased in preparation for the arrivalof more airborne pet dander. For another embodiment relating to personalsafety-area networks, the hazard detector service robot 162 can beadvised by other smart-home sensors that the temperature and humiditylevels are rising in the kitchen, which is nearby to the occupant'scurrent dining room location, and responsive to this advisory the hazarddetector service robot 162 will temporarily raise a hazard detectionthreshold, such as a smoke detection threshold, under an inference thatany small increases in ambient smoke levels will most likely be due tocooking activity and not due to a genuinely hazardous condition.

The above-described “human-facing” and “away” functionalities can beprovided, without limitation, by multiple distinct service robots 162having respective dedicated ones of such functionalities, by a singleservice robot 162 having an integration of two or more different ones ofsuch functionalities, and/or any combinations thereof (including theability for a single service robot 162 to have both “away” and “humanfacing” functionalities) without departing from the scope of the presentteachings. Electrical power can be provided by virtue of rechargeablebatteries or other rechargeable methods, with FIG. 1 illustrating anexemplary out-of-the-way docking station 164 to which the service robots162 will automatically dock and recharge its batteries (if needed)during periods of inactivity. Preferably, each service robot 162includes wireless communication components that facilitate datacommunications with one or more of the other wirelessly communicatingsmart-home sensors of FIG. 1 and/or with one or more other servicerobots 162 (e.g., using Wi-Fi, ZigBee, Z-Wave, 6LoWPAN, etc.), and oneor more of the smart-home devices of FIG. 1 can be in communication witha remote server over the Internet. Alternatively or in conjunctiontherewith, each service robot 162 can be configured to communicatedirectly with a remote server by virtue of cellular telephonecommunications, satellite communications, 3G/4G network datacommunications, or other direct communication method.

Provided according to some embodiments are systems and methods relatingto the integration of the service robot(s) 162 with home securitysensors and related functionalities of the smart home system. Theembodiments are particularly applicable and advantageous when appliedfor those service robots 162 that perform “away” functionalities or thatotherwise are desirable to be active when the home is unoccupied(hereinafter “away-service robots”). Included in the embodiments aremethods and systems for ensuring that home security systems, intrusiondetection systems, and/or occupancy-sensitive environmental controlsystems (for example, occupancy-sensitive automated setback thermostatsthat enter into a lower-energy-using condition when the home isunoccupied) are not erroneously triggered by the away-service robots.

Provided according to some embodiments is a home automation and securitysystem (e.g., as shown in FIG. 1) that is remotely monitored by amonitoring service by virtue of automated systems (e.g., cloud-basedservers or other central servers, hereinafter “central server”) that arein data communications with one or more network-connected elements ofthe home automation and security system. The away-service robots areconfigured to be in operative data communication with the centralserver, and are configured such that they remain in a non-away-servicestate (e.g., a dormant state at their docking station) unless permissionis granted from the central server (e.g., by virtue of an“away-service-OK” message from the central server) to commence theiraway-service activities. An away-state determination made by the system,which can be arrived at (i) exclusively by local on-premises smartdevice(s) based on occupancy sensor data, (ii) exclusively by thecentral server based on received occupancy sensor data and/or based onreceived proximity-related information such as GPS coordinates from usersmartphones or automobiles, or (iii) any combination of (i) and (ii) canthen trigger the granting of away-service permission to the away-servicerobots by the central server. During the course of the away-servicerobot activity, during which the away-service robots may continuouslydetect and send their in-home location coordinates to the centralserver, the central server can readily filter signals from the occupancysensing devices to distinguish between the away-service robot activityversus any unexpected intrusion activity, thereby avoiding a falseintrusion alarm condition while also ensuring that the home is secure.Alternatively or in conjunction therewith, the central server mayprovide filtering data (such as an expected occupancy-sensing profiletriggered by the away-service robots) to the occupancy sensing nodes orassociated processing nodes of the smart home, such that the filteringis performed at the local level. Although somewhat less secure, it wouldalso be within the scope of the present teachings for the central serverto temporarily disable the occupancy sensing equipment for the durationof the away-service robot activity.

According to another embodiment, functionality similar to that of thecentral server in the above example can be performed by an on-sitecomputing device such as a dedicated server computer, a “master” homeautomation console or panel, or as an adjunct function of one or more ofthe smart-home devices of FIG. 1. In such an embodiment, there would beno dependency on a remote service provider to provide the“away-service-OK” permission to the away-service robots and thefalse-alarm-avoidance filtering service or filter information for thesensed intrusion detection signals.

According to other embodiments, there are provided methods and systemsfor implementing away-service robot functionality while avoiding falsehome security alarms and false occupancy-sensitive environmentalcontrols without the requirement of a single overall event orchestrator.For purposes of the simplicity in the present disclosure, the homesecurity systems and/or occupancy-sensitive environmental controls thatwould be triggered by the motion, noise, vibrations, or otherdisturbances of the away-service robot activity are referenced simply as“activity sensing systems,” and when so triggered will yield a“disturbance-detected” outcome representative of the false trigger (forexample, an alarm message to a security service, or an “arrival”determination for an automated setback thermostat that causes the hometo be heated or cooled to a more comfortable “occupied” setpointtemperature). According to one embodiment, the away-service robots areconfigured to emit a standard ultrasonic sound throughout the course oftheir away-service activity, the activity sensing systems are configuredto detect that standard ultrasonic sound, and the activity sensingsystems are further configured such that no disturbance-detected outcomewill occur for as long as that standard ultrasonic sound is detected.For other embodiments, the away-service robots are configured to emit astandard notification signal throughout the course of their away-serviceactivity, the activity sensing systems are configured to detect thatstandard notification signal, and the activity sensing systems arefurther configured such that no disturbance-detected outcome will occurfor as long as that standard notification signal is detected, whereinthe standard notification signal comprises one or more of: an opticalnotifying signal; an audible notifying signal; an infrared notifyingsignal; an infrasonic notifying signal; a wirelessly transmitted datanotification signal (e.g., an IP broadcast, multicast, or unicastnotification signal, or a notification message sent in an TCP/IP two-waycommunication session).

According to some embodiments, the notification signals sent by theaway-service robots to the activity sensing systems are authenticatedand encrypted such that the notifications cannot be learned andreplicated by a potential burglar. Any of a variety of knownencryption/authentication schemes can be used to ensure such datasecurity including, but not limited to, methods involving third partydata security services or certificate authorities. For some embodiments,a permission request-response model can be used, wherein any particularaway-service robot requests permission from each activity sensing systemin the home when it is ready to perform its away-service tasks, and doesnot initiate such activity until receiving a “yes” or “permissiongranted” message from each activity sensing system (or from a singleactivity sensing system serving as a “spokesman” for all of the activitysensing systems). One advantage of the described embodiments that do notrequire a central event orchestrator is that there can (optionally) bemore of an arms-length relationship between the supplier(s) of the homesecurity/environmental control equipment, on the one hand, and thesupplier(s) of the away-service robot(s), on the other hand, as it isonly required that there is the described standard one-way notificationprotocol or the described standard two-way request/permission protocolto be agreed upon by the respective suppliers.

According to still other embodiments, the activity sensing systems areconfigured to detect sounds, vibrations, RF emissions, or otherdetectable environmental signals or “signatures” that are intrinsicallyassociated with the away-service activity of each away-service robot,and are further configured such that no disturbance-detected outcomewill occur for as long as that particular detectable signal orenvironmental “signature” is detected. By way of example, a particularkind of vacuum-cleaning away-service robot may emit a specific sound orRF signature. For one embodiment, the away-service environmentalsignatures for each of multiple known away-service robots are stored inthe memory of the activity sensing systems based on empiricallycollected data, the environmental signatures being supplied with theactivity sensing systems and periodically updated by a remote updateserver. For another embodiment, the activity sensing systems can beplaced into a “training mode” for the particular home in which they areinstalled, wherein they “listen” and “learn” the particularenvironmental signatures of the away-service robots for that home duringthat training session, and thereafter will suppress disturbance-detectedoutcomes for intervals in which those environmental signatures areheard.

For still another embodiment, which is particularly useful when theactivity sensing system is associated with occupancy-sensitiveenvironmental control equipment rather than a home security system, theactivity sensing system is configured to automatically learn theenvironmental signatures for the away-service robots by virtue ofautomatically performing correlations over time between detectedenvironmental signatures and detected occupancy activity. By way ofexample, for one embodiment an intelligent automatednonoccupancy-triggered setback thermostat such as the Nest LearningThermostat can be configured to constantly monitor for audible and RFactivity as well as to perform infrared-based occupancy detection. Inparticular view of the fact that the environmental signature of theaway-service robot will remain relatively constant from event to event,and in view of the fact that the away-service events will likely either(a) themselves be triggered by some sort of nonoccupancy condition asmeasured by the away-service robots themselves, or (b) occur at regulartimes of day, there will be patterns in the collected data by which theevents themselves will become apparent and for which the environmentalsignatures can be readily learned. Generally speaking, for thisautomatic-learning embodiment in which the environmental signatures ofthe away-service robots are automatically learned without requiring userinteraction, it is more preferable that a certain number of falsetriggers be tolerable over the course of the learning process.Accordingly, this automatic-learning embodiment is more preferable forapplication in occupancy-sensitive environmental control equipment (suchas an automated setback thermostat) rather than home security systemsfor the reason that a few false occupancy determinations may cause a fewinstances of unnecessary heating or cooling, but will not otherwise haveany serious consequences, whereas false home security alarms may havemore serious consequences.

According to embodiments, technologies including the sensors of thesmart devices located in the mesh network of the smart-home environmentin combination with rules-based inference engines or artificialintelligence provided at the central server or cloud-computing system164 are used to provide a personal “smart alarm clock” for individualoccupants of the home. For example, user-occupants can communicate withthe central server or cloud-computing system 164 via their mobiledevices 166 to access an interface for the smart alarm clock. There,occupants can turn on their “smart alarm clock” and input a wake timefor the next day and/or for additional days. In some embodiments, theoccupant may have the option of setting a specific wake time for eachday of the week, as well as the option of setting some or all of theinputted wake times to “repeat”. Artificial intelligence will be used toconsider the occupant's response to these alarms when they go off andmake inferences about the user's preferred sleep patterns over time.

According to embodiments, the smart device in the smart-home environment100 that happens to be closest to the occupant when the occupant fallsasleep will be the device that transmits messages regarding when theoccupant stopped moving, from which the central server orcloud-computing system 164 will make inferences about where and when theoccupant prefers to sleep. This closest smart device will as be thedevice that sounds the alarm to wake the occupant. In this manner, the“smart alarm clock” will follow the occupant throughout the house, bytracking the individual occupants based on their “unique signature”,which is determined based on data obtained from sensors located in thesmart devices. For example, the sensors include ultrasonic sensors,passive IR sensors, and the like. The unique signature is based on acombination of walking gait, patterns of movement, voice, height, size,etc. It should be appreciated that facial recognition may also be used.

According to an embodiment, the wake times associated with the “smartalarm clock” are used by the smart thermostat 102 to control the HVAC inan efficient manner so as to pre-heat or cool the house to theoccupant's desired “sleeping” and “awake” temperature settings. Thepreferred settings can be learned over time, such as by observing whichtemperature the occupant sets the thermostat to before going to sleepand which temperature the occupant sets the thermostat to upon wakingup.

According to an embodiment, a device is positioned proximate to theoccupant's bed, such as on an adjacent nightstand, and collects data asthe occupant sleeps using noise sensors, motion sensors (e.g.,ultrasonic, IR, and optical), etc. Data may be obtained by the othersmart devices in the room as well. Such data may include the occupant'sbreathing patterns, heart rate, movement, etc. Inferences are made basedon this data in combination with data that indicates when the occupantactually wakes up. For example, if—on a regular basis—the occupant'sheart rate, breathing, and moving all increase by 5% to 10%, twenty tothirty minutes before the occupant wakes up each morning, thenpredictions can be made regarding when the occupant is going to wake.Other devices in the home can use these predictions to provide othersmart-home objectives, such as adjusting the smart thermostat 102 so asto pre-heat or cool the home to the occupant's desired setting beforethe occupant wakes up. Further, these predictions can be used to set the“smart alarm clock” for the occupant, to turn on lights, etc.

According to embodiments, technologies including the sensors of thesmart devices located throughout the smart-home environment incombination with rules-based inference engines or artificialintelligence provided at the central server or cloud-computing system164 are used to detect or monitor the progress of Alzheimer's disease.For example, the unique signatures of the occupants are used to trackthe individual occupants' movement throughout the smart-home environment100. This data can be aggregated and analyzed to identify patternsindicative of Alzheimer's. Oftentimes, individuals with Alzheimer's havedistinctive patterns of migration in their homes. For example, a personwill walk to the kitchen and stand there for a while, then to the livingroom and stand there for a while, and then back to the kitchen. Thispattern will take about thirty minutes, and then the person will repeatthe pattern. According to embodiments, the remote servers or cloudcomputing architectures 164 analyze the person's migration datacollected by the mesh network of the smart-home environment to identifysuch patterns.

FIG. 2 illustrates a network-level view of an extensible devices andservices platform 200 with which multiple smart-home environments, suchas the smart-home environment 100 of FIG. 1, can be integrated. Theextensible devices and services platform 200 includes remote servers orcloud computing architectures 164. Each of the smart devices cancommunicate with the remote servers or cloud computing architectures164. For example, a connection to the Internet 162 can be establishedeither directly (for example, using 3G/4G connectivity to a wirelesscarrier), through a wireless mesh network (which can be a scheme rangingfrom a simple wireless router, for example, up to and including anintelligent, dedicated whole-home control node), or through anycombination thereof. The smart network may couple to the Internet 162using a hub 212.

Although in some examples provided herein, the devices and servicesplatform 200 communicates with and collects data from the smart devicesof smart-home environment 100 of FIG. 1, it should be appreciated thatthe devices and services platform 200 may communicate with and collectdata from multiple smart-home environments across the world. Forexample, the central server or cloud-computing system 164 can collecthome data 202 from the devices of one or more smart-home environments,where the devices can routinely transmit home data or can transmit homedata in specific instances (e.g., when a device queries the home data202). Thus, the devices and services platform 200 may routinely collectdata from homes across the world. As described, the collected home data202 includes, for example, power consumption data, occupancy data, HVACsettings and usage data, carbon monoxide levels data, carbon dioxidelevels data, volatile organic compounds levels data, sleeping scheduledata, cooking schedule data, inside and outside temperature humiditydata, television viewership data, inside and outside noise level data,etc.

The central server or cloud-computing architecture 164 can furtherprovide one or more services 204. The services 204 can include, e.g.,software updates, customer support, sensor data collection/logging,weather information, account information, remote access, remote ordistributed control, or use suggestions (e.g., based on collected homedata 202 to improve performance, reduce utility cost, etc.). Dataassociated with the services 204 can be stored at the central server orcloud-computing system 164 and the central server or the cloud-computingsystem 164 can retrieve and transmit the data at an appropriate time(e.g., at regular intervals, upon receiving a request from a user,etc.).

As illustrated in FIG. 2, an embodiment of the extensible devices andservices platform 200 includes a processing engine 206, which can beconcentrated at a single server or distributed among several differentcomputing entities without limitation. The processing engine 206 caninclude engines configured to receive data from devices of smart-homeenvironments (e.g., via the Internet or a hubbed network), to index thedata, to analyze the data and/or to generate statistics based on theanalysis or as part of the analysis. The analyzed data can be stored asderived home data 208.

Results of the analysis or statistics can thereafter be transmitted backto the device that provided home data used to derive the results, toother devices, to a server providing a webpage to a user of the device,or to other non-device entities. For example, use statistics, usestatistics relative to use of other devices, use patterns, and/orstatistics summarizing sensor readings can be generated by theprocessing engine 206 and transmitted. The results or statistics can beprovided via the Internet 162. In this manner, the processing engine 206can be configured and programmed to derive a variety of usefulinformation from the home data 202. A single server can include one ormore engines.

The derived data can be highly beneficial at a variety of differentgranularities for a variety of useful purposes, ranging from explicitprogrammed control of the devices on a per-home, per-neighborhood, orper-region basis (for example, demand-response programs for electricalutilities), to the generation of inferential abstractions that canassist on a per-home basis (for example, an inference can be drawn thatthe homeowner has left for vacation and so security detection equipmentcan be put on heightened sensitivity), to the generation of statisticsand associated inferential abstractions that can be used for governmentor charitable purposes. For example, processing engine 206 can generatestatistics about device usage across a population of devices and sendthe statistics to device users, service providers or other entities(e.g., that have requested or may have provided monetary compensationfor the statistics).

According to some embodiments, the home data 202, the derived home data208, and/or another data can be used to create “automated neighborhoodsafety networks.” For example, in the event the central server orcloud-computing architecture 164 receives data indicating that aparticular home has been broken into, is experiencing a fire, or someother type of emergency event, an alarm is sent to other smart homes inthe “neighborhood.” In some instances, the central server orcloud-computing architecture 164 automatically identifies smart homeswithin a radius of the home experiencing the emergency and sends analarm to the identified homes. In such instances, the other homes in the“neighborhood” do not have to sign up for or register to be a part of asafety network, but instead are notified of an emergency based on theirproximity to the location of the emergency. This creates robust andevolving neighborhood security watch networks, such that if one person'shome is getting broken into, an alarm can be sent to nearby homes, suchas by audio announcements via the smart devices located in those homes.Additionally or alternatively, if a neighbor's hazard detector detectsmoke, neighboring houses may activate irrigation systems to reducelikelihood of a spread of fire. It should be appreciated that thissafety network can be an opt-in service and that, in addition to orinstead of the central server or cloud-computing architecture 164selecting which homes to send alerts to, individuals can subscribe toparticipate in such networks and individuals can specify which homesthey want to receive alerts from. This can include, for example, thehomes of family members who live in different cities, such thatindividuals can receive alerts when their loved ones in other locationsare experiencing an emergency.

According to some embodiments, sound, vibration, and/or motion sensingcomponents of the smart devices are used to detect sound, vibration,and/or motion created by running water. Based on the detected sound,vibration, and/or motion, the central server or cloud-computingarchitecture 164 makes inferences about water usage in the home andprovides related services. For example, the central server orcloud-computing architecture 164 can run programs/algorithms thatrecognize what water sounds like and when it is running in the home.According to one embodiment, to map the various water sources of thehome, upon detecting running water, the central server orcloud-computing architecture 164 sends a message an occupant's mobiledevice asking if water is currently running or if water has beenrecently run in the home and, if so, which room and whichwater-consumption appliance (e.g., sink, shower, toilet, etc.) was thesource of the water. This enables the central server or cloud-computingarchitecture 164 to determine the “signature” or “fingerprint” of eachwater source in the home. This is sometimes referred to herein as “audiofingerprinting water usage.”

In one illustrative example, the central server or cloud-computingarchitecture 164 creates a signature for the toilet in the masterbathroom, and whenever that toilet is flushed, the central server orcloud-computing architecture 164 will know that the water usage at thattime is associated with that toilet. Thus, the central server orcloud-computing architecture 164 can track the water usage of thattoilet as well as each water-consumption application in the home. Thisinformation can be correlated to water bills or smart water meters so asto provide users with a breakdown of their water usage.

According to some embodiments, sound, vibration, and/or motion sensingcomponents of the smart devices are used to detect sound, vibration,and/or motion created by mice and other rodents as well as by termites,cockroaches, and other insects (collectively referred to as “pests”).Based on the detected sound, vibration, and/or motion, the centralserver or cloud-computing architecture 164 makes inferences aboutpest-detection in the home and provides related services. For example,the central server or cloud-computing architecture 164 can runprograms/algorithms that recognize what certain pests sound like, howthey move, and/or the vibration they create, individually and/orcollectively. According to one embodiment, the central server orcloud-computing architecture 164 can determine the “signatures” ofparticular types of pests.

For example, in the event the central server or cloud-computingarchitecture 164 detects sounds that may be associated with pests, itnotifies the occupants of such sounds and suggests hiring a pest controlcompany. If it is confirmed that pests are indeed present, the occupantsinput to the central server or cloud-computing architecture 164 confirmsthat its detection was correct, along with details regarding theidentified pests, such as name, type, description, location, quantity,etc. This enables the central server or cloud-computing architecture 164to “tune” itself for better detection and create “signatures” or“fingerprints” for specific types of pests. For example, the centralserver or cloud-computing architecture 164 can use the tuning as well asthe signatures and fingerprints to detect pests in other homes, such asnearby homes that may be experiencing problems with the same pests.Further, for example, in the event that two or more homes in a“neighborhood” are experiencing problems with the same or similar typesof pests, the central server or cloud-computing architecture 164 canmake inferences that nearby homes may also have such problems or may besusceptible to having such problems, and it can send warning messages tothose homes to help facilitate early detection and prevention.

In some embodiments, to encourage innovation and research and toincrease products and services available to users, the devices andservices platform 200 expose a range of application programminginterfaces (APIs) 210 to third parties, such as charities 222,governmental entities 224 (e.g., the Food and Drug Administration or theEnvironmental Protection Agency), academic institutions 226 (e.g.,university researchers), businesses 228 (e.g., providing devicewarranties or service to related equipment, targeting advertisementsbased on home data), utility companies 230, and other third parties. TheAPIs 210 may be coupled to and permit third-party systems to communicatewith the central server or the cloud-computing system 164, including theservices 204, the processing engine 206, the home data 202, and thederived home data 208. For example, APIs 210 may allow applicationsexecuted by the third parties to initiate specific data processing tasksthat are executed by the central server or the cloud-computing system164, as well as to receive dynamic updates to the home data 202 and thederived home data 208.

For example, third parties can develop programs and/or applications,such as web or mobile apps that integrate with the central server or thecloud-computing system 164 to provide services and information to users.Such programs and application may be, for example, designed to helpusers reduce energy consumption, to preemptively service faultyequipment, to prepare for high service demands, to track past serviceperformance, etc., or to perform any of a variety of beneficialfunctions or tasks now known or hereinafter developed.

According to some embodiments, third-party applications make inferencesfrom the home data 202 and the derived home data 208, such inferencesmay include when are occupants home, when are they sleeping, when arethey cooking, when are they in the den watching television, and when dothey shower. The answers to these questions may help third-partiesbenefit consumers by providing them with interesting information,products and services as well as with providing them with targetedadvertisements.

In one example, a shipping company creates an application that makesinferences regarding when people are at home. The application uses theinferences to schedule deliveries for times when people will most likelybe at home. The application can also build delivery routes around thesescheduled times. This reduces the number of instances where the shippingcompany has to make multiple attempts to deliver packages, and itreduces the number of times consumers have to pick up their packagesfrom the shipping company.

FIG. 3 illustrates a functional view 300 of the extensible devices andservices platform 200 of FIG. 2, with particular reference to theprocessing engine 206 as well as devices, such as those of thesmart-home environment 100 of FIG. 1. Even though devices situated insmart-home environments may have an endless variety of differentindividual capabilities and limitations, they can all be thought of assharing common characteristics in that each of them is a data consumer302 (DC), a data source 304 (DS), a services consumer 306 (SC), and aservices source 308 (SS). Advantageously, in addition to providing theessential control information needed for the devices to achieve theirlocal and immediate objectives, the extensible devices and servicesplatform 200 can also be configured to harness the large amount of datathat is flowing out of these devices. In addition to enhancing oroptimizing the actual operation of the devices themselves with respectto their immediate functions, the extensible devices and servicesplatform 200 can be directed to “repurposing” that data in a variety ofautomated, extensible, flexible, and/or scalable ways to achieve avariety of useful objectives. These objectives may be predefined oradaptively identified based on, e.g., usage patterns, device efficiency,and/or user input (e.g., requesting specific functionality).

For example, FIG. 3 shows processing engine 206 as including a number ofparadigms 310. Processing engine 206 can include a managed servicesparadigm 310 a that monitors and manages primary or secondary devicefunctions. The device functions can include ensuring proper operation ofa device given user inputs, estimating that (e.g., and responding to aninstance in which) an intruder is or is attempting to be in a dwelling,detecting a failure of equipment coupled to the device (e.g., a lightbulb having burned out), implementing or otherwise responding to energydemand response events, or alerting a user of a current or predictedfuture event or characteristic. Processing engine 206 can furtherinclude an advertising/communication paradigm 310 b that estimatescharacteristics (e.g., demographic information), desires and/or productsof interest of a user based on device usage. Services, promotions,products or upgrades can then be offered or automatically provided tothe user. Processing engine 206 can further include a social paradigm310 c that uses information from a social network, provides informationto a social network (for example, based on device usage), and/orprocesses data associated with user and/or device interactions with thesocial network platform. For example, a user's status as reported totheir trusted contacts on the social network could be updated toindicate when they are home based on light detection, security systeminactivation or device usage detectors. As another example, a user maybe able to share device-usage statistics with other users. In yetanother example, a user may share HVAC settings that result in low powerbills and other users may download the HVAC settings to their smartthermostat 102 to reduce their power bills.

The processing engine 206 can include achallenges/rules/compliance/rewards paradigm 310 d that informs a userof challenges, competitions, rules, compliance regulations and/orrewards and/or that uses operation data to determine whether a challengehas been met, a rule or regulation has been complied with and/or areward has been earned. The challenges, rules or regulations can relateto efforts to conserve energy, to live safely (e.g., reducing exposureto toxins or carcinogens), to conserve money and/or equipment life, toimprove health, etc. For example, one challenge may involve participantsturning down their thermostat by one degree for one week. Those thatsuccessfully complete the challenge are rewarded, such as by coupons,virtual currency, status, etc. Regarding compliance, an example involvesa rental-property owner making a rule that no renters are permitted toaccess certain owner's rooms. The devices in the room having occupancysensors could send updates to the owner when the room is accessed.

The processing engine 206 may integrate or otherwise utilize extrinsicinformation 316 from extrinsic sources to improve the functioning of oneor more processing paradigms. Extrinsic information 316 can be used tointerpret data received from a device, to determine a characteristic ofthe environment near the device (e.g., outside a structure that thedevice is enclosed in), to determine services or products available tothe user, to identify a social network or social-network information, todetermine contact information of entities (e.g., public-service entitiessuch as an emergency-response team, the police or a hospital) near thedevice, etc., to identify statistical or environmental conditions,trends or other information associated with a home or neighborhood, andso forth.

An extraordinary range and variety of benefits may be brought about by,and fit within the scope of, the described extensible devices andservices platform 200, ranging from the ordinary to the profound. Thus,in one “ordinary” example, each bedroom of the smart-home environment100 can be provided with a smart wall switch 108, a smart wall plug 110,and/or smart hazard detectors 104, all or some of which include anoccupancy sensor, wherein the occupancy sensor is also capable ofinferring (e.g., by virtue of motion detection, facial recognition,audible sound patterns, etc.) whether the occupant is asleep or awake.If a fire event is sensed, the remote security/monitoring service orfire department is advised of how many occupants there are in eachbedroom, and whether those occupants are still asleep (or immobile) orwhether they have properly evacuated the bedroom. While this is, ofcourse, a very advantageous capability accommodated by the describedextensible devices and services platform, there can be substantiallymore “profound” examples that can truly illustrate the potential of alarger “intelligence” that can be made available. By way of perhaps amore “profound” example, the same bedroom occupancy data that is beingused for fire safety can also be “repurposed” by the processing engine206 in the context of a social paradigm of neighborhood childdevelopment and education. Thus, for example, the same bedroom occupancyand motion data discussed in the “ordinary” example can be collected andmade available (properly anonymized) for processing in which the sleeppatterns of schoolchildren in a particular ZIP code can be identifiedand tracked. Localized variations in the sleeping patterns of theschoolchildren may be identified and correlated, for example, todifferent nutrition programs in local schools.

Smart Devices

By way of introduction, FIG. 4 illustrates an example of a device 410(e.g., thermostat and/or hazard detector) that may that may communicatewith other like devices within a home environment. In one embodiment,the device 410 may include one or more sensors 412, a user interfacecomponent 14, a power supply 416 (e.g., including a power connectionand/or battery), a network interface 418, a processor 420, and the like.Particular sensors 412, user interface components 414, and power-supplyconfigurations may be the same or similar within each device 410.However, it should be noted that in some embodiments, each device 410may include particular sensors 412, user interface components 414,power-supply configurations, and the like based on a device type ormodel.

The sensors 412, in certain embodiments, may detect various propertiessuch as acceleration, temperature, humidity, water, supplied power,proximity, external motion, device motion, sound signals, ultrasoundsignals, light signals, fire, smoke, carbon monoxide,global-positioning-satellite (GPS) signals, radio-frequency (RF), otherelectromagnetic signals, or fields, or the like. As such, the sensors412 may include temperature sensor(s), humidity sensor(s),hazard-related sensor(s) or other environmental sensor(s),accelerometer(s), microphone(s), optical sensors up to and includingcamera(s) (e.g., charged coupled-device or video cameras), active orpassive radiation sensors, GPS receiver(s), radiofrequencyidentification detector(s) and/or other suitable sensors. While FIG. 4illustrates an embodiment with a single sensor, many embodiments mayinclude multiple sensors. In some instances, the device 410 may includesone or more primary sensors and one or more secondary sensors. Here, theprimary sensor(s) may sense data central to the core operation of thedevice (e.g., sensing a temperature in a thermostat or sensing smoke ina smoke detector), while the secondary sensor(s) may sense other typesof data (e.g., motion, light or sound), which can be used forenergy-efficiency objectives, security objectives, safety objectives,and/or smart-operation objectives.

One or more user interface components 414 in the device 410 may receiveinput from the user and/or present information to the user. The receivedinput may be used to determine one or more settings. In certainembodiments, the user interface components may include a mechanical orvirtual component that responds to the user's motion. For example, theuser may mechanically move a sliding component (e.g., along a verticalor horizontal track) or rotate a rotatable ring (e.g., along a circulartrack), or move an object (e.g., finger) across/onto a touchpad of thedevice 410. Such motions may correspond to a setting adjustment, whichcan be determined based on an absolute position of a user interfacecomponent 414 or based on a displacement of a user interface components414 (e.g., adjusting a set point temperature by 1 degree F. for every10° rotation of a rotatable-ring component). Physically and virtuallymovable user interface components can allow a user to set a settingalong a portion of an apparent continuum. Thus, the user may not beconfined to choose between two discrete options (e.g., as would be thecase if up and down buttons were used) but can quickly and intuitivelydefine a setting along a range of possible setting values. For example,a magnitude of a movement of a user interface component may beassociated with a magnitude of a setting adjustment, such that a usermay dramatically alter a setting with a large movement or finely tune asetting with s small movement.

The user interface components 414 may also include one or more buttons(e.g., up and down buttons), a keypad, a number pad, a switch, amicrophone, and/or a camera (e.g., to detect gestures). In someembodiments, the user interface component 414 may include aclick-and-rotate annular ring component that may enable the user tointeract with the component by rotating the ring (e.g., to adjust asetting) and/or by clicking the ring inwards (e.g., to select anadjusted setting or to select an option). In another embodiment, theuser interface component 414 may include a camera that may detectgestures (e.g., to indicate that a power or alarm state of a device isto be changed). In some instances, the device 410 may have one primaryinput component, which may be used to set a plurality of types ofsettings. The user interface components 414 may also be configured topresent information to a user via, e.g., a visual display (e.g., athin-film-transistor display or organic light-emitting-diode display)and/or an audio speaker.

The power-supply component 16 may include a power connection and/or alocal battery. For example, the power connection may connect the device410 to a power source such as a line voltage source. In some instances,an AC power source can be used to repeatedly charge a (e.g.,rechargeable) local battery, such that the battery may be used later tosupply power to the device 410 when the AC power source is notavailable.

The network interface 418 may include a component that enables thedevice 410 to communicate between devices. In one embodiment, thenetwork interface 418 may communicate using an efficient network layeras part of its Open Systems Interconnection (OSI) model. In oneembodiment, the efficient network layer, which will be described in moredetail below with reference to FIG. 5, may enable the device 410 towirelessly communicate IPv6-type data or traffic using a RIPng routingmechanism and a DTLS security scheme. As such, the network interface 418may include a wireless card or some other transceiver connection.

The processor 420 may support one or more of a variety of differentdevice functionalities. As such, the processor 420 may include one ormore processors configured and programmed to carry out and/or cause tobe carried out one or more of the functionalities described herein. Inone embodiment, the processor 420 may include general-purpose processorscarrying out computer code stored in local memory (e.g., flash memory,hard drive, random access memory), special-purpose processors orapplication-specific integrated circuits, combinations thereof, and/orusing other types of hardware/firmware/software processing platforms.Further, the processor 420 may be implemented as localized versions orcounterparts of algorithms carried out or governed remotely by centralservers or cloud-based systems, such as by virtue of running a Javavirtual machine (JVM) that executes instructions provided from a cloudserver using Asynchronous JavaScript and XML (AJAX) or similarprotocols. By way of example, the processor 420 may detect when alocation (e.g., a house or room) is occupied, up to and includingwhether it is occupied by a specific person or is occupied by a specificnumber of people (e.g., relative to one or more thresholds). In oneembodiment, this detection can occur, e.g., by analyzing microphonesignals, detecting user movements (e.g., in front of a device),detecting openings and closings of doors or garage doors, detectingwireless signals, detecting an IP address of a received signal,detecting operation of one or more devices within a time window, or thelike. Moreover, the processor 420 may include image recognitiontechnology to identify particular occupants or objects.

In certain embodiments, the processor 420 may also include a high-powerprocessor and a low-power processor. The high-power processor mayexecute computational intensive operations such as operating the userinterface component 414 and the like. The low-power processor, on theother hand, may manage less complex processes such as detecting a hazardor temperature from the sensor 412. In one embodiment, the low-powerprocessor may wake or initialize the high-power processor forcomputationally intensive processes.

In some instances, the processor 420 may predict desirable settingsand/or implement those settings. For example, based on the presencedetection, the processor 420 may adjust device settings to, e.g.,conserve power when nobody is home or in a particular room or to accordwith user preferences (e.g., general at-home preferences oruser-specific preferences). As another example, based on the detectionof a particular person, animal or object (e.g., a child, pet or lostobject), the processor 420 may initiate an audio or visual indicator ofwhere the person, animal or object is or may initiate an alarm orsecurity feature if an unrecognized person is detected under certainconditions (e.g., at night or when lights are off).

In some instances, devices may interact with each other such that eventsdetected by an instructed device influences actions of an instructeddevice. For example, an instructed device can detect that a user haspulled into a garage (e.g., by detecting motion in the garage, detectinga change in light in the garage or detecting opening of the garagedoor). The instructed device can transmit this information to aninstructed device via the efficient network layer, such that theinstructed device can, e.g., adjust a home temperature setting, a lightsetting, a music setting, and/or a security-alarm setting. As anotherexample, an instructed device can detect a user approaching a front door(e.g., by detecting motion or sudden light pattern changes). Theinstructed device may, e.g., cause a general audio or visual signal tobe presented (e.g., such as sounding of a doorbell) or cause alocation-specific audio or visual signal to be presented (e.g., toannounce the visitor's presence within a room that a user is occupying).

By way of example, the device 410 may include a thermostat such as aNest® Learning Thermostat. Here, the thermostat may include sensors 412such as temperature sensors, humidity sensors, and the like such thatthe thermostat may determine present climate conditions within abuilding where the thermostat is disposed. The power-supply component 16for the thermostat may be a local battery such that the thermostat maybe placed anywhere in the building without regard to being placed inclose proximity to a continuous power source. Since the thermostat maybe powered using a local battery, the thermostat may minimize its energyuse such that the battery is rarely replaced.

In one embodiment, the thermostat may include a circular track that mayhave a rotatable ring disposed thereon as the user interface component414. As such, a user may interact with or program the thermostat usingthe rotatable ring such that the thermostat controls the temperature ofthe building by controlling a heating, ventilation, and air-conditioning(HVAC) unit or the like. In some instances, the thermostat may determinewhen the building may be vacant based on its programming. For instance,if the thermostat is programmed to keep the HVAC unit powered off for anextended period of time, the thermostat may determine that the buildingwill be vacant during this period of time. Here, the thermostat may beprogrammed to turn off light switches or other electronic devices whenit determines that the building is vacant. As such, the thermostat mayuse the network interface 418 to communicate with a light switch devicesuch that it may send a signal to the light switch device when thebuilding is determined to be vacant. In this manner, the thermostat mayefficiently manage the energy use of the building.

Keeping the examples of FIGS. 1-4 in mind, FIG. 5 illustrates an examplewireless mesh network 422 that may be employed to facilitatecommunication between some of the devices, such as those describedabove. As shown in FIG. 5, a thermostat 424 may have a direct wirelessconnection to a plug interface 426, which may be wirelessly connected toa hazard detection unit 430 and to a light switch 432. In the samemanner, the light switch 432 may be wirelessly coupled to a portableelectronic device 436 and an appliance 434. The appliance 438 may justbe coupled to a pool heater 440 and the portable electronic device 434may just be coupled to an irrigation system 442. The irrigation system442 may have a wireless connection to an entryway interface device 444.

Generally, the network 422 may be part of an Open SystemsInterconnection (OSI) model 450 as depicted in FIG. 6. The OSI model 450illustrates functions of a communication system with respect toabstraction layers. That is, the OSI model may specify a networkingframework or how communications between devices may be implemented. Inone embodiment, the OSI model 450 may include six layers: a physicallayer 452, a data link layer 454, a network layer 456, a transport layer458, a platform layer 460, and an application layer 462. Generally, eachlayer in the OSI model 450 may serve the layer above it and may beserved by the layer below it.

Keeping this in mind, the physical layer 452 may provide hardwarespecifications for devices that may communicate with each other. Assuch, the physical layer 452 may establish how devices may connect toeach other, assist in managing how communication resources may be sharedbetween devices, and the like.

The data link layer 454 may specify how data may be transferred betweendevices. Generally, the data link layer 454 may provide a way in whichdata packets being transmitted may be encoded and decoded into bits aspart of a transmission protocol.

The network layer 456 may specify how the data being transferred to adestination node is routed. The network layer 456 may also interfacewith a security protocol in the application layer 462 to ensure that theintegrity of the data being transferred is maintained.

The transport layer 458 may specify a transparent transfer of the datafrom a source node to a destination node. The transport layer 458 mayalso control how the transparent transfer of the data remains reliable.As such, the transport layer 458 may be used to verify that data packetsintended to transfer to the destination node indeed reached thedestination node. Example protocols that may be employed in thetransport layer 458 may include Transmission Control Protocol (TCP) andUser Datagram Protocol (UDP).

The platform layer 460 may establish connections between devicesaccording to the protocol specified within the transport layer 458. Theplatform layer 460 may also translate the data packets into a form thatthe application layer 462 may use. The application layer 462 may supporta software application that may directly interface with the user. Assuch, the application layer 462 may implement protocols defined by thesoftware application. For example, the software application may provideserves such as file transfers, electronic mail, and the like.

The network layer 456 may route data between the devices 10 using acommunication protocol based on Internet Protocol version 6 (IPv6). Assuch, each device 410 may include a 128-bit IPv6 address that mayprovide each device 410 with a unique address to use to identify itselfover the Internet, a local network or a fabric overlaying a group ofnetworks, or the like. In some embodiments, the network layer 456 mayidentify a protocol (e.g., RIPng) that determines how data is routedbetween the devices. As illustrated in FIG. 7, using one or more layers,information 470 may be exchanged between devices 472 and 474.

Fabric Pairing Process

In some embodiments, a joining device may join a fabric using acommissioner via various communication paths (e.g., 802.11, 802.15.4, acombination of networks). Regardless of how communication is establishedbetween the joining device and its commissioner, there is a defined setof interactions which are performed, network provisioning, fabricjoining, and service provisioning and account pairing. In someembodiments, these interactions are restricted to a specific order, suchas network provisioning before fabric joining and fabric joining beforeservice provisioning and account pairing. In some embodiments, somejoining devices may only perform some of the interactions. For example,if the joining device is a radiator box that is provisioned for networkand fabric access but is not provisioned for service access orexplicitly paired to the user's account.

In some embodiments, the joining device may be paired to a fabric usingassistance from a mobile device. The mobile device may employ a mobileapplication that is primarily responsible for acting as a commissionerand provisioning joining devices. In certain embodiments, any device onthe network may act as the commissioner. In some embodiments, somedevices (e.g., thermostats) support commissioning only to pair withsubordinate devices (e.g., radiator boxes). In certain embodiments, somedevices (e.g., hazard detectors devices) may provide a commissioner withnetwork and fabric provisioning information, but they do not themselvescommission new devices.

As previously discussed, in some scenarios, a process for pairingadditional devices to a fabric may include user input to cause acommissioner to connect to the joining device's self-hosted WiFi accesspoint using a mobile app. In such embodiments, the user manuallydisconnects from their current WiFi network to connect to theself-hosted AP, and the user manually rejoins their previous networkonce the new device has been provisioned. Therefore, such joiningprocesses use substantial user interaction.

To free users from manually switching networks during the additionaldevice pairing process, a new mechanism is used to securely connect thejoining device to fabric devices via one or more networks (e.g.,802.15.4) so that network provisioning may occur via this connection.While the fabric devices and the joining device may rendezvous via WiFi,in some embodiments, the fabric devices would disconnect from the home'sWiFi network to rendezvous with the joining device, disrupting regularservice for the user and potentially creating a more invasive experiencefor the user. Instead, in network-assisted fabric joining a commissionerconnects to the joining device through more than one network byconnecting to an assisting device in a first network (e.g., 802.11) andrelying on the assisting device to enable the commissioner to establisha tunnel to the joining device through another network (e.g., 802.15.4).Thus, as will be discussed below, the assisting device providesconnectivity to the joining device through another network.

FIG. 8 illustrates a device connection scheme 480 including acommissioner 482. Although the commissioner is illustrated as a smartphone, the commissioner 482 may be any device (e.g., fabric device)suitable for controlling communications with a joining device 484 to beadded to a fabric on which an assisting device 486 resides. Thecommissioner 482 connects to the assisting device 486 via an accesspoint 488 for a network 490 (e.g., WiFi). As will be discussed below,the assisting device 486 then establishes a connection with the joiningdevice 484 through another network 494 (e.g., 802.15.4). Through theassisting device 486, the commissioner 482 establishes a secure tunnel496 with the joining device 484. As will be discussed below, the securetunnel 496 enables the commissioner 482 and the joining device 484 tocommunicate securely without forcing the commissioner 482 to actuallyjoin a network which the joining device 484 resides and/or has created.In other words, the commissioner 482 may communicate with the joiningdevice 484 even when the joining device 482 cannot readily join thenetwork 490 with additional interaction with the joining device 482without changing a network to which the commissioner 482 is connected.Thus, the commissioner 482 may provide a more streamlined interactionthan a scenario in which the commissioner 482 joins the joining device484 on a network created by the joining device 484 or on which thejoining device 484 resides.

FIGS. 9A-9C illustrate a flow diagram of a pairing process 500 by thecommissioner 482. The process 500 begins by the commissioner 482receiving account information (block 502). For example, the commissioner482 may obtain the account information from a user via a mobile deviceapplication program or a web browser. Additionally or alternatively, thecommissioner 482 may retrieve the account information from storage onthe commissioner 482 or remote from the commissioner 482 (e.g., storedin a remote service). Using the account information, the commissioner482 authenticates to a remote service (block 504). In some embodiments,the account information may be stored in and retrieved from the remoteservice. In such embodiments, the commissioner 482 may authenticate tothe service with authentication keys different than the accountinformation and may retrieve the account information afterauthenticating to the remote service. After authentication in anymethod, the commissioner 482 receives a service authentication token anda fabric authorization token that are stored and may be used later(block 506). The commissioner 482 also receives an indication to add thejoining device 484 to the fabric (block 508). For example, a user mayselect an add device button on the mobile device application or anothersuitable indication.

In some embodiments, the indication to add the joining device 484includes an indication of a device type of the joining device 484. Usingthe device type, the commissioner 482 determines whether the joiningdevice supports the pairing process 500. If the device type cannotsupport the pairing process 500, the commissioner 482 continues with aswitching pairing process that uses switching of a network to which thecommissioner 482 is connected (block 512). If the device type supportsthe pairing process 500, the commissioner 482 obtains fabric serviceconfiguration information from the service to be used in pairing thejoining device 484 to the service and/or the fabric (block 514). Thefabric service configuration information includes any information whichmay be helpful in pairing the joining device 484 to the fabric and theremote service. For example, the fabric service configurationinformation may include a service node ID for the joining device 484(e.g., extended unique identifier EUI-64 format), a set of certificatesfor the service, a globally unique account id associated with the user'saccount, a DNS host name identifying an entry point for the remoteservice, and an opaque account pairing token that may be used to pairthe joining device 484 to the remote service.

The commissioner 482 may also receive information to identify thejoining device 484 (block 516). For example, the commissioner 484 mayprompt the user to input a code associated with and/or found on thedevice and/or scan a code (e.g., QR code) found on the device to verifythat the correct joining device is being paired to the fabric and/or theservice. The commissioner 482 determines whether a device identifier isvalid (block 518). For example, the commissioner 482 may determinewhether a valid check digit exists or the identifier is an expectedvalue. If the device identifier is not valid, the commissioner 482indicates failure (block 520). For example, the commissioner 482 maydisplay a notification to the user that the identifier is not valid andre-requests entry of the identifier.

If the identifier is valid, the commissioner 482 determines whether afabric exists for a structure in which the joining device 484 is to beadded (block 522). Such determination may include requesting the user toinput a structure for the joining device 484, and the commissioner 482determines whether a fabric exists for the structure. If no fabricexists, then the network-assisted pairing process ends since noassisting device exists (block 524). If a fabric exists, thecommissioner 482 receives a response from the service. The response mayinclude information about the fabric, such as device types, softwareversions, and node identifiers for the devices in the fabric, as well asa fabric identifier for the fabric.

If a pre-existing fabric exists, the commissioner 482 determines whetherthe devices in the fabric include non-sleepy devices (i.e., always-ondevices that do not toggle into a relatively low power mode) (block526). If there is at least one non-sleepy device, the commissioner 482selects an always-on device as the assisting device 486 (block 528). Ifall devices in the fabric are sleepy devices, the commissioner 482determines whether a sleepy device can be awoken by the service (block530). If so, the commissioner 482 instructs the service to awaken thedevice as the assisting device 486 (block 532). If no devices may beawoken by the service, the commissioner 482 instructs the user tomanually waken a device on the fabric (block 534). For example, thecommissioner 482 may instruct the user to press a button on theassisting device 486.

Once an assisting device 486 has been selected and/or awoken, thecommissioner 482 establishes a secure connection to the assisting device486 using the fabric authentication previously received by thecommissioner 482 in block 506 (block 536). In some embodiments, thesecure session may be established using Certificate AuthenticatedSession Establishment (CASE) protocol as taught in U.S. patentapplication Ser. No. 14/508,933, titled “Authenticated SessionEstablishment,” which was filed on Oct. 7, 2014, and which isincorporated by reference in its entirety. The commissioner 482 thenstores the resulting session key and assisting device node identifier.In some embodiments, the commissioner 482 uses a device control profile,as discussed below, to employ connection monitoring on the connectionbetween the commissioner 482 and the assisting device 486. Via thesecure connection, the commissioner 482 extracts network and fabricconfiguration from the assisting device 486 (block 538). For example,the commissioner 482 may use network provisioning and fabricprovisioning profiles to obtain this information. For example, thecommissioner 482 may use Network and Fabric Provisioning Profiles asdescribed in U.S. Provisional Patent Application No. 62/061,593, titled“Fabric Network,” which was filed on Oct. 8, 2014, and which isincorporated by reference in its entirety. In certain embodiments, thecommissioner 482 may receive a pre-share key (PSK) for the service ormay rely on provisioning support to change the network handling to allowone to query a provisioning PSK. The commissioner 482 also instructs theassisting device 486 to place the network (e.g., 802.15.4) in a joinablemode and listen for rendezvous connections on an unsecured port (block540). In some embodiments, the commissioner 482 then disables the devicecontrol profile connection monitor.

In some embodiments, the commissioner 482 causes the joining device 484to be awoken and/or placed in a communicative state (block 542). Forexample, in some embodiments, the commissioner 482 may instruct a userto manually awaken the joining device 484 and/or send a signal over apredefined port to awaken the device from a relatively low-power state.As discussed below, the commissioner 482 connects to the joining device484 as remote passive rendezvous (RPR) client and initiates a RPR usingthe device control profile (block 542). In some embodiments, connectingto the joining device 484 includes receiving a notification from theassisting device 486 that the assisting device 485 has rendezvoused withthe joining device 484 and opened an RPR tunnel from the joining device484 to the commissioner 482. The communications between the joiningdevice 484 and the commissioner 482 will occur through the tunnel asforwarded by the assisting device 486 and its separate connections tothe joining device 484 and the commissioner 482. Furthermore, theconnection may include the commissioner 482 enabling device controlprofile connection monitoring between the joining device 484 and thecommissioner 482.

After the rendezvous tunnel has been established, the commissionerattempts to establish a secure fabric session with the joining device484 using a pairing code that is the device identifier, is derived fromthe device identifier, or corresponds to the device identifier (block546). In some embodiments, the secure fabric session may be establishedusing Password Authenticated Session Establishment (PASE) protocol astaught in U.S. patent application Ser. No. 14/508,933, titled“Authenticated Session Establishment,” which was filed on Oct. 7, 2014,and which is incorporated by reference in its entirety. The commissionerdetermines whether the joining device 484 is authentic such that thePASE connection has been established successfully (block 548). If thejoining device 484 is not authenticated, the commissioner 482 causes thetermination of the tunnel and connection monitoring (block 550). Inother words, the RPR session is terminated, and the commissioner willattempt to restart the RPR session using stored fabric and nodeinformation previously stored. In some embodiments, the commissioner 482may notify of such failures (block 552). For example, the commissioner482 may display a failure to a user to indicate the failure.

If the device authenticates, the commissioner 482 determines devicecapabilities and software versions before instructing the device to joina network (block 554). For example, the commissioner 482 may perform afabric identify request to determine a device type and software versionfor the joining device 484. The commissioner 482 then verifies that thedevice type of the joining device 484 matches the selected device typeused for the pairing (block 556). If the device types do no match, thecommissioner 482 may notify the user of the failure and terminate theprocess 500 (block 558). In some embodiments, the commissioner 482 mayrestart the process 500 at block 508. If the selected device typesmatch, the commissioner 482 may also determine whether the softwareversion of the commissioner 482 supports network-assisted fabric pairing(block 560). If the version of software on the joining device 484 doesnot support network-assisted fabric pairing and/or needs to be updated,the commissioner 482 causes the software version to be updated (block562). For example, the commissioner 482 may cause the joining device 484to initiate an update and/or indicate to a user that the joining device484 should be updated. Once the software version is appropriate for thefabric pairing, the commissioner 482 may determine whether the joiningdevice 484 has WiFi capability (block 564). If the device has WiFicapability, the commissioner 482 causes the joining device 484 to add aWiFi network associated with the fabric (block 566). In other words, thejoining device 484 stores network credentials (e.g., SSID and password)for the WiFi network. The commissioner 482 also causes the joiningdevice 484 to initiate a connectivity test (block 568). For example, thecommissioner 482 may instruct the joining device 484 to connect to theWiFi network, perform a DNS lookup, and establish a test TCP connectionto an Internet-based test server. The commissioner 482 determineswhether the connectivity test has passed (block 570). If the testfailed, the commissioner 482 and/or the joining device may request newWiFi credentials (block 572) then reattempt the WiFi connection. In someembodiments, the joining device may reattempt to connect beforerequesting new WiFi credentials. If the test is passed, the commissioner482 may request that the joining device 484 enable the WiFi network(block 574).

Regardless of WiFi capabilities, the commissioner 484 causes the joiningdevice to add a personal area network (PAN) (block 576). The PANcredentials and name to be joined have been previously retrieved fromthe assisting device 486 and are shared with the joining device 484 bythe commissioner 482. After the joining device 484 has the PANcredentials, the commissioner 482 causes the joining device 484 toenable the PAN network (block 578). In other words, the PAN is thesecure connection version of the unsecured connection (e.g., via802.15.4) over which the communication between the commissioner 482 andthe joining device 484. If the secure re-connection between the joiningdevice 484 and the commissioner 482 fails (block 580), the failsafe istriggered either through the unsecure port connection or automaticallyafter a period of time elapses after the joining device 484 attempts tojoin the PAN (block 582).

Once the joining device 484 has joined the PAN, using the previouslyretrieve fabric ID and keys, the commissioner 482 instructs the joiningdevice 484 to join the fabric (block 584). The commissioner 482 alsoconfigures the joining device 484 to communicate with the remote serviceby sending a register service request including the fabric serviceconfiguration information previously retrieved from the service (block586). Since the pairing for the joining device 484 is complete, thecommissioner 482 may disable a failsafe in the joining device to allowthe fabric and network information to be stored persistently (block588). The commissioner 482 then determines whether additional devicesare to be added to the network and/or fabric (block 590). If there areno additional devices, the process 500 has ended. If there areadditional devices, the commissioner 482 returns to block 508 of FIG.9A.

Rendezvous Algorithm

As previously discussed, the network-assisted pairing rendezvousalgorithm is the process by which a new fabric device (e.g., joiningdevice 484) attempts to locate and connect to an existing fabric device(e.g., assisting device 486) for purposes of setup and provisioning thenew fabric device. In other words, the network-assisted pairingrendezvous algorithm causes the new fabric device to provisionally jointhe right PAN, connect to the right existing device, and establish asecure fabric session with this device via PASE authentication.

FIG. 10 illustrates a state machine 600 for the rendezvous algorithm. Aspart of the algorithm, the new fabric device keeps a PAN blacklist andordered list of scan results of PAN networks that includes a retrycounter and timestamp for each scan result.

The algorithm may also include several tunable parameters: the number ofresults per scan queued for the attempted rendezvous, the number ofrendezvous retries per result per scan, the rendezvous retry back offduration, the PAN blacklist size, and the PAN blacklist timeoutduration. The number of results per scan queued for attempted rendezvoushas several constraints, such an amount of memory available on therendezvousing device, a desire for a new device to avoid attemptingrendezvous with every PAN in an environment. In other words, thisconstraint keeps the number of scan results queued for attemptedrendezvous at a desirable size, so that the new device does not try torendezvous with existing devices on PANs with low signal strengths whichare not likely to contain the desired rendezvous host.

Another constraint on the number of results per scan is the estimatednumber of PANs visible to a typical new device with signal strengthshigher than the right PAN. If there are too many strong-signal “falsepositive” PANs, the number of results per scan queued for attemptedrendezvous may be sufficiently large or the new device may not connectto the right PAN. In some embodiments, the value of this parameter maybe between 10-20 scan results.

In some embodiments, scanning for networks is slow and is to be avoidedwhenever possible. If a new device attempts to rendezvous with anexisting device on a given PAN and this attempt is unsuccessful forreasons other than PASE authentication failure, the PAN may be the rightPAN but unable to complete the rendezvous attempt because the existingdevice was busy talking to a different new device. In this case, in someembodiments, the other new device's rendezvous attempt is bound to fail,and in much less time than it would take for the first new device toperform another network scan. Thus, in some embodiments, the first newdevice may delay its next scan, and retry its rendezvous later. Theparameters which determine when and how often the instructed device willretry its rendezvous are the rendezvous retry back off duration andrendezvous retry per-PAN, per-scan maximum.

In some embodiments, only one device may attempt PASE authenticationwith the commissioner 482 via RPR at a time. The length of therendezvous retry back off duration will thus be based on the duration ofa typical PASE authentication attempt, such that one device will retry afailed rendezvous attempt with a given existing device as soon asanother new device's rendezvous attempt with that existing device wouldlikely have failed. The number of rendezvous retries may be large enoughfor the new device to reap the benefits of delaying its scan when queuedfor a rendezvous attempt, while also small enough for the new device tore-scan eventually in case it missed its rendezvous PAN in an earlierscan attempt. In some embodiments, the value of this parameter may bebetween 3-5 retries per result per scan.

If a new device's rendezvous attempt is unsuccessful due to PASEauthentication failure, the new device may assume that it will not beable to rendezvous with the rendezvous host on this particular PANwithin a given period, and add this PAN to its blacklist. The purpose ofthe PAN blacklist is for a device which knows it cannot rendezvous withanyone on a particular PAN to back off so that other devices may attemptto rendezvous with that PAN's rendezvous host. The size of the PANblacklist may be determined in relation to an amount of memory availableon the rendezvousing devices. For example, the PAN blacklist may besimilar in size to the number of results per scan queued for attemptedrendezvous.

In some embodiments, PANs on the blacklist may be removed from theblacklist after a set timeout to handle the case where the usersequentially pairs more than one additional device. In this case, thoughthe commissioner 482 may attempt to rendezvous with only one device at atime, other new devices whose turns it will soon be to pair may also beawake and attempting to rendezvous. These other new devices may failPASE authentication with the right existing device on the right PANbefore it is their turn to rendezvous. When their turn comes, however,these devices may be able to connect to the same device on the same PANfor which PASE authentication may have failed for them previously. Thusthe blacklist timeout may be close to the shortest expected amount oftime taken by the user to rendezvous with, provision, and set up anyfabric device. For example, in some embodiments, this timeout maybe setto between 1-2 minutes. For some devices whose pairing interactions areshorter, the timeout value may be reduced over devices with longerpairing interaction times.

In some embodiments, the user may be directed by the commissioner 482 towake only one new device at a time for additional device pairing, so theblacklist may be largely unnecessary. One case in which the blacklistmay cover is that in which the user simultaneously wakes, e.g.button-presses, many new devices which they intend to pair one by one.

This algorithm will succeed quickly in the simple case where only asingle joiner is present and only a single joinable PAN is visible.Assuming all joiners adhere to this algorithm, more difficult cases withmultiple joiners and/or multiple joinable PANs may take longer.

In some embodiments, it may be desirable to implement a feature whichenables the user to batch-pair many new additional Fabric devices. Theexisting rendezvous algorithm and Remote Passive Rendezvous mechanismcould be adapted for this use case by extending the RPR server's MACaddress filtering capability. In addition to rejecting rendezvousparticipants with non-matching MAC addresses, the RPR server could passthe MAC address of each new device to the RPR client, such that thelatter could select the pairing code with which to authenticate each newdevice via J-PAKE and the PASE protocol. In this scenario, thenetwork-assisted pairing rendezvous algorithm would work without anymodification, and the RPR client would not iterate through the full listof possible pairing keys when attempting to authenticate each newdevice.

Returning to FIG. 10 with the foregoing in mind, the state machine 600includes an initial state where the joining device 484 gets the nextscan result from its queue (block 602). If the queue is empty, thejoining device 484 scans for networks (block 604). The joining device484 gets the scan results, drops the blacklisted results, selects thetop N results based on maximum results constraint, assigns a number ofretries to each result, and shuffles the result queue. The first scanresult is obtained from the queue. The joining device attempts toprovisionally join the PAN from the queue (block 606). If the attempt isunsuccessful and the retries are less than the constraint, the joiningdevice attempts to retry to join the PAN. If the attempt is unsuccessfuland the number of retries is greater than the constraint, theprovisional joining has failed. When the attempt has failed the joiningdevice 484 decrements the retry counter on the scan result (block 608)and gets a new scan result.

However, if the provisional joining of the PAN is successful, thejoining device 484 attempts to form a TCP connection with the rendezvoushost (e.g., assisting device 486) on unsecure port (block 610). If theTCP connection fails, the joining device 484 decrements the retrycounter on the scan result and gets a new scan result. If the TCPconnection is successfully completed, the joining device 484 awaits asecure session establishment from the assisting device 486 (block 612).If the connection closes or the secure session establishment times out,the joining device 484 decrements the retry counter on the scan resultand gets a new scan result. If the secure session is successfullyestablished, the rendezvous is complete and the joining device 484awaits provisioning and pairing as described in FIGS. 9A-9C (block 614).

Device Control Profile

The Device Control Profile allows one device acting as a client (e.g.,commissioner 482) to request that another device acting as a server(e.g., assisting device 486 and/or joining device 484) exercise aspecified device control capability. In other words, the profile enablesdevices to remotely access fabric functionality on remote devices wherethe fabric functionality may be used for the new device setup andprovisioning process. Device control capabilities are as any action,behavior, or state modification which one fabric device may request ofanother in relation to new device setup and provisioning.

1. Reset Configuration

One device may instruct another to reset any combination of its network,fabric, or service configurations to a known state, such as in the casewhere the instructed device detects a partial misconfiguration of theinstructed device during the pairing and setup process.

2. Arm/Disarm Failsafe

One device may instruct another to arm or disarm a device configurationfailsafe. As previously discussed, if armed, the failsafe indicates tothe instructed device that total configuration details should be resetto a known state in the event of setup or provisioning failure. Forexample, if a connection between two devices fails during networkprovisioning, the joining device forgets all configuration details.

3. Enable/Disable Connection Monitor

One device may instruct another to enable a fabric echo-based connectionliveness monitor on a TCP, UDP, or other suitable connection betweenthese devices. The instructed device may send echo requests on themonitored connection at intervals specified by the instructing device.Both devices start timers when the connection monitor is enabled andrestart these timers whenever they receive an echo message. If either ofthese timers expires, the device which owns the expired timer mayconsider the connection terminated. In some embodiments, the instructingdevice specifies the duration of this inactivity timeout.

4. Remote Passive Rendezvous

As previously discussed, n instructing device may instruct another tocreate a TCP-layer (or UDP) tunnel between the instructing device and ajoining device to rendezvous with the instructed device on theinstructed device's unsecured fabric port. This tunnel may consist oftwo TCP and/or UDP connections: one from the instructing device to theinstructed device and one from the instructed device to the joining(i.e., rendezvoused) device. The instructed device may send data thatcomes in over one of these connections out over the other, and similarlymirror connection closures and half-closures. This functionality enablesthe instructed device to perform fabric provisioning on the rendezvouseddevice such that the two devices might interact even when not on thesame network.

Protocol Sequence Diagrams

Device Control Profile interactions may vary by device controlcapability and may have a list of commands common to some interactions.However, each interaction includes a device control server and a devicecontrol client. Device control clients initiate protocol interactionswith device control servers. In some embodiments, each device controlserver may not be capable of implementing all described capabilities. Ifthe device control server receives a message requesting a capabilitywhich it does not support, the device control server may return a coreprofile status report with the request's exchange ID and an “unsupportedmessage” status code. For example, the commissioner 482 may use a StatusReport scheme that is part of a Core Profile as described in U.S.Provisional Patent Application No. 62/061,593, titled “Fabric Network,”which was filed on Oct. 8, 2014, and which is incorporated by referencein its entirety. Devices which act as device control servers may alsoact as device control clients, and vice-versa.

1. Reset Configuration

FIG. 11 illustrates a sequence diagram for a reset configurationrequest. A device control client 620 may instruct a device controlserver 622 to reset any combination of the server's network, fabric, orservice configurations to a known state. This is a singlerequest-response interaction. First, the client 620 may send the servera reset configuration request 624 whose body contains flags indicatingwhich configurations to reset. The server 622 may then prepare to resetthe specified configurations, and send the client 620 a core profilestatus report 626 to indicate success or a device control profile“unsupported failsafe mode” status report to indicate failure.

After the server 622 responds with a core profile status report 620 toindicate success, the server may reset the specified configurations. Insome embodiments, the server 622 cannot reset its configurations beforeit responds to the client's request, as to do so may render it unable tocommunicate further with the client.

2. Arm Failsafe

FIG. 12 illustrates a sequence diagram for a new arm failsafe request. Adevice control client 620 may request that a device control server 622arm its configuration failsafe. This is a single request-responseinteraction. As discussed below in relation to data frames, an armrequest 628 may include an 8-bit arm mode enumeration value and a 32-bitfailsafe token. The failsafe token may be unique to each fabricprovisioning attempt, and indicate to new device control clients whetheranother client has already armed that server's failsafe as part of anin-progress provisioning process.

The failsafe arm modes include New, Reset, and Resume Existing. A Newarm request 628 may arm the server's failsafe and set its failsafe tokento the value provided in the client's request if the failsafe is notalready armed, and fail otherwise. If a New arm request 628 succeeds,the server 622 may send the client 620 a core profile status report 630to indicate success. If a New arm request 628 fails because the server'sfailsafe is already active, the server 622 may send the client 620 adevice control profile “failsafe already active” status report 630. If aNew arm request 628 fails for some other reason, the server 622 may sendthe client an appropriate core profile status report 630.

FIG. 13 illustrates a sequence diagram for a Reset arm request. A Resetarm request 632 may reset the server's network, fabric, and/or serviceconfigurations, arm the failsafe regardless of its prior state or anyexisting failsafe token, and/or set the failsafe token to the valueprovided in the client's request. If a Reset arm request 632 succeeds,the server 622 may send the client 620 a core profile status report 634to indicate success. If a Reset arm request 632 fails, the server 622may send the client 620 an appropriate core profile status report 634.

FIG. 14 illustrates a sequence diagram for a Resume Existing armfailsafe request. A Resume Existing arm request 636 may arm the failsafeand set the failsafe token to the value provided in the client's requestif the failsafe is not already armed, or succeed if the failsafe isalready armed with the specified failsafe token, and fail otherwise. Ifa Resume Existing arm request 636 succeeds, the server 622 may send theclient 620 a core profile status report 638 to indicate success. If aResume Existing arm request 636 fails because the server's failsafe isalready armed with a failsafe token other than that provided by theclient 620, the server 622 may send the client 620 a device controlprofile “no matching failsafe active” status report 638. If a ResumeExisting arm request 636 fails for some other reason, the server 622 maysend the client 620 an appropriate core profile status report 638.

A device control client 620 may use the Resume Existing arm mode in thecase where it reconnects to a new, partially provisioned device after aperiod of network disconnection. If the Resume Existing request succeedswith the client's earlier failsafe token, the client 620 may assume thatno other device has taken over the new device's provisioning process. Ifthe Resume Existing request fails, the client 620 may assume thatanother device has taken over the new device's provisioning process, andthat the client 620 device should not attempt to provision the newdevice unless its failsafe becomes disarmed and it remainsunprovisioned.

If the server 622 receives an arm failsafe message with an unknown armmode, it may send the client 620 a device control profile “unsupportedfailsafe mode” status report.

3. Disarm Failsafe

FIG. 15 illustrates a sequence diagram for a disarm failsafe request. Adevice control client 620 may request that a device control server 622disable its configuration failsafe. In some embodiments, this is asingle request-response interaction. The client 620 sends the server 622a disarm failsafe request 640. If the server's failsafe is armed, theserver 622 disarms the failsafe, clears the failsafe token, and sendsthe client 620 a core profile status report 642 message to indicatesuccess. If the server's failsafe is disarmed, it sends a device controlprofile “no failsafe active” status report 642.

4. Enable/Disable Connection Monitor

FIG. 16 illustrates a sequence diagram for a connection monitor. Adevice control client 620 may request 644 that a device control server622 enables a fabric echo-based connection liveness monitor on a TCP (orUDP) connection between the server 622 and the client 620. The client'srequest 644 to enable connection monitoring may specify the interval inmilliseconds between each of the server's attempts to send echorequests, as well as the response timeout to be used by the server foreach echo request sent. The response timeout is defined as the thresholdduration during which no communication occurs across the monitoredconnection before either side may consider the connection closed. Forproper operation of the connection monitor, the fabric echo sendinterval must be smaller than the response timeout. The connection to bemonitored is that over which the client sends the enable connectionmonitor request.

If the server 622 accepts the client's request 644 to enable connectionmonitoring, it may respond with a core profile status report 646 toindicate success, and create a new exchange ID for fabric echo messagessent over the monitored connection. Fabric echo requests 648 from theserver 622 to the client 620, as well as fabric echo responses from 650the client 620 to the server 622, may be sent with the new exchange ID.If the server 622 fails to enable connection monitoring, the server 622may respond with an appropriate core profile status report 646 toindicate failure.

After the server 622 accepts the client's request 644 to enableconnection monitoring, it may start a timer with a duration of the sendinterval from the client's request 644. When this timer expires, theserver 622 may send a fabric echo request 648 to the client over themonitored connection using the new exchange ID created for this purpose.This echo request 648 may be sent with the response timeout received bythe server 622 as part of the client's initial request 644. If thistimeout expires, the server 622 may consider the monitored connectionterminated and close its side of the connection. If there is already oneecho request outstanding when the send timer expires, the server 622 mayrefrain from sending another.

After the client 620 receives a successful status report 646 from theserver in response to its request 644 to enable connection monitoring,the client 620 may start a timer with a duration of the response timeoutsent to the server 622. If this timer expires, the client 620 mayconsider the monitored connection terminated and close its side of theconnection.

When the client 620 wishes to disable connection monitoring on a givenconnection, it may send the server 622 a disable connection monitorrequest 652 over that connection. The server 622 may then disable themonitor for this connection if enabled, cancel all timers for thisconnection monitor and send the client 620 a core profile status report654 to indicate success or failure. The server 622 may respond to adisable connection monitor request 652 with a core profile successstatus report 654 if no connection monitor is enabled on the specifiedconnection.

5. Remote Passive Rendezvous Request

FIG. 17 illustrates a sequence diagram for a remote passive rendezvousrequest. A device control client 620 may instruct a device controlserver 622 to create a TCP-layer tunnel between the client 620 and arendezvoused device 656 to rendezvous with the server 622 on itsunsecured fabric port. The unsecured fabric port is a predefined portover which all fabric protocol traffic is treated as unsecured at thenetwork layer. The tunnel between the client 620 and rendezvoused device656 may consist of two TCP connections: one from the client 620 to theserver 622, and one from the server 622 to the rendezvoused device 656.The server 622 may send all data that comes in over one connection outover the other, and similarly mirror connection closures andhalf-closures.

The client 620 to perform a remote passive rendezvous may first send theserver an RPR request 658 over an established TCP connection. Therequest 658 may contain a timeout value which indicates how long theserver 622, if it accepts the client's request, may listen for arendezvous connection on the unsecured fabric port. The request 658 mayalso include an inactivity timeout which indicates how long the server622 may wait to terminate the tunnel after receiving no data over itsconnection to either the client 622 or rendezvoused device 656. If therendezvous timeout expires before the server 622 accepts an unsecuredrendezvous connection 662, the server 622 may stop listening for such aconnection on the client's behalf and close the connection over whichthe client sent its RPR request 658. Finally, the request 658 may alsocontain a fabric node ID value which the server 622 may use to filterunsecured rendezvous connections. The filtering is transparent from theclient's perspective (i.e. the server will not connect the client 620 toa rendezvoused device 656 with an incorrect node ID). In someembodiments, a null value indicates that the server should not use nodeID filtering. If the server 622 accepts the client's RPR request 656,the TCP connection over which this request 658 was sent may eventuallybecome the connection over which the server 622 forwards traffic betweenthe client 620 and the rendezvoused device 656.

When the server 622 receives the client's RPR request 658, it mayregister the client 620 as its RPR listener and respond with a coreprofile status report 660 to indicate success if the server 622 isalready listening for rendezvous connections on the unsecured fabricport and/or another client 622 is not already registered with the serveras its RPR listener. Otherwise the server 622 may respond with a coreprofile status report 660 to indicate failure. The server 622 may haveonly one registered RPR listener at a time.

In some embodiments, the device control profile does not include amethod to instruct the device control server 622 to listen forrendezvous connections on the unsecured Fabric port. Instead, in suchembodiments, that functionality is provided by the Network ProvisioningProfile.

When the client 620 receives a successful status report 660 in responseto an RPR request 658, it may keep open the TCP (or UDP) connection overwhich it sent this request 658 until either the rendezvous timeoutexpires or the server 622 closes this connection. The client 620 maysend no further fabric message or other data over this connection untilit receives a remote connection complete message 664 from the server622. If the client 620 detects that the rendezvous timeout from its RPRrequest 658 has expired, it may close its connection to the server 622.

If the rendezvous timeout specified in the client's RPR request 658expires before the server 622 accepts a rendezvous connection on behalfof the client 620, the server 622 may stop listening for such aconnection on the client's behalf and close the connection over whichthe client sent its RPR request 658. If the server 622 receives arendezvous connection before the rendezvous timeout expires, it maycancel this timeout. The server 622 may discard any data received fromthe client 620 over the RPR connection after a successful status report660 has been sent in response to the client's RPR request and before theserver 622 has sent the client 620 a remote connection complete message.

If the server 622 accepts a rendezvous connection on the unsecuredfabric port while it listens for such connections on the client'sbehalf, the server 622 first compares the rendezvoused device's fabricnode ID to that specified in the client's RPR request 658, if any. Ifthe IDs match or the client-specified node ID is null, the server 622may deregister the client 620 as an RPR listener and send the client 620a remote connection complete message 664 via the same TCP connectionover which it received the client's RPR request 658. If theclient-specified node ID is non-null and does not match that of therendezvoused device 656, the server 622 may immediately close itsconnection with the rendezvoused device 656 and resume listening forunsecured rendezvouses on the client's behalf.

The remote connection complete message 664 indicates that the client 620may now send and receive data over this connection to and from therendezvoused device 658. Once this message 664 has been sent, the tunnelbetween the client 620 and rendezvoused device 656 is considered to havebeen established.

The server 622 sends the remote connection complete message 664 beforeit starts forwarding data 666 between the client 620 and rendezvouseddevice 656. If the rendezvoused device 656 sends data over itsconnection to the server 622 before the remote connection completemessage 664 has been sent to the client 620, the server 622 buffers thedata from the rendezvoused device 656 and sends it to the client 620immediately after it sends the remote connection complete message 664.In some embodiments, once the server 622 has sent the remote connectioncomplete message 664, it may no longer send non-forwarded data (i.e.data of its own origin over its connections to the client 620 andrendezvoused device 656).

The rendezvoused device 656 is agnostic of whether the device with whomit exchanges packets over the rendezvoused TCP connection differs fromthe fabric node with whom it actually exchanges messages over thisconnection.

After the tunnel has been established, if the server 622 does notreceive data from either side of the tunnel within the inactivitytimeout period specified in the client's RPR request, the server 622 mayconsider the tunnel terminated and close its connections to both theclient 620 and the rendezvoused device 656. To avoid unwanted tunneltermination as the result of this timeout, the client 620 andrendezvoused device 656 may enable active connection monitoring betweenthem.

When the client 620 or rendezvoused device 656 closes their connectionwith the server 622, the server 622 may close its connection with theother tunnel participant and consider the tunnel terminated. If theclient 620 or rendezvoused device 656 closes only the read or write sideof their connection to the server, the server 622 may close only theread or write side of its connection to the other tunnel participant,and consider the tunnel alive until either it times out due toinactivity or the remaining open side of the connection is closed.

Fabric Application Header

In order for a device control profile frame to be properly recognizedand handled, the fabric application header may identify the frame assuch. For example, messages using the device control profile include afabric application header (e.g., 0x00000006) for device control profileframes. All messages in reset configuration, arm/disarm failsafe, andenable/disable connection monitor protocol interactions may share anexchange ID of the message sent by the device control client to initiatethe interaction illustrating that the communications are all related.Fabric echo requests and responses used to determine connection livenessmay share the exchange ID selected for this purpose by the devicecontrol server for each echo message sent. The exchange ID of the remoteconnection complete message sent to the device control client by thedevice control server as part of a remote passive rendezvous interactionis undefined, as the client does not send any message to the devicecontrol server in response. In some embodiments, at least some dataframes may have no message body and purely rely upon information in theheaders of the applications.

A message type field of the fabric application header may have one ofthe following set of values for Device Control Profile frames:

TABLE 1 Device Control Profile message types Value Message Type 0x01reset configuration 0x02 arm failsafe 0x03 disarm failsafe 0x04 enableconnection monitor 0x05 disable connection monitor 0x06 remote passiverendezvous request 0x07 remote connection complete 0x08-0xff reservedTable 2 illustrates status codes that may be used related to failsafemessages:

TABLE 2 Status codes Value Status Code 0x0001 Failsafe already active0x0002 No failsafe active 0x0003 No matching failsafe active 0x0004Unsupported failsafe mode 0x0005 Success, but expect connection to close

1. Reset Configuration Frame

FIG. 18 illustrates a data frame for a reset configuration data frame.As illustrated, the reset configuration data frame 668 includes 2 bytesof data that is used as flags to indicate which targets are to be resetand may be similar to those values illustrated in Table 3 below:

TABLE 3 Reset configuration values Value Flag 0x00FF reset allconfigurations 0x0001 reset network configuration 0x0002 reset fabricconfiguration 0x0004 reset service configuration 0x8000 full factoryreset

2. Arm Failsafe Frame

FIG. 19 illustrates a data frame for an arm failsafe data frame. Asillustrated, the arm failsafe data frame 670 includes an arm mode field672 that includes 1 byte of data that is used as flags to indicate whichfailsafe mode is to be used and may be similar to those valuesillustrated in Table 4 below:

TABLE 4 Arm failsafe values Value Arm mode 0x01 New 0x02 Reset 0x03Resume Existing

The arm failsafe frame 670 also includes a failsafe token 674 that maybe used to identify the arm failsafe request and validate it. Thefailsafe token 674 may be a 4-byte arbitrary value unique to each fabricprovisioning attempt.

3. Enable Connection Monitor Frame

FIG. 20 illustrates a data frame for an enable connection monitor frame.As illustrated, the enable connection monitor frame 676 includes aconnection monitor timeout 678 and a connection monitor interval 680. Insome embodiments, both the connection monitor timeout 678 and theconnection monitor interval 680 include 2 bytes of data. The connectionmonitor timeout 678 indicates how long a connection can remain idlebefore timing out. The connection monitor interval 680 indicates howoften echo requests are sent.

4. Remote Passive Rendezvous Request Frame

FIG. 21 illustrates a remote passive rendezvous request frame. Theremote passive rendezvous request frame 682 includes a rendezvoustimeout field 684 and an inactivity timeout field 686. The rendezvousand inactivity timeouts may be 16-bit unsigned integer values inseconds. The rendezvous timeout field 684 indicates how long the attemptmay remain open, and the inactivity timeout field 686 indicates how longinactivity may occur on the RPR connection before closing theconnection. The remote passive rendezvous request frame 682 alsoincludes a filter node ID 688. In some embodiments, the filter node ID688 includes 8 bytes that may be used to verify that the rendezvousedjoining device is the correct device.

The specific embodiments described above have been shown by way ofexample, and it should be understood that these embodiments may besusceptible to various modifications and alternative forms. It should befurther understood that the claims are not intended to be limited to theparticular forms disclosed, but rather to cover all modifications,equivalents, and alternatives falling within the spirit and scope ofthis disclosure.

1. A method for joining a device to a fabric, comprising: receiving anindication to add a joining device to a fabric; determining whether thejoining device supports network-assisted fabric pairing; and if thejoining device supports network-assisted fabric pairing: establishing afirst secure communication channel with an assisting device, wherein theassisting device is configured to assist the joining device in joiningthe fabric; instructing the assisting device to place a local areanetwork in a joinable mode; establishing a second secure communicationchannel to the joining device via the assisting device; and sendingfabric credentials for the fabric to be joined by the joining device viathe second secure communication channel.
 2. The method of claim 1,comprising obtaining the fabric credentials from the assisting devicefor the fabric to be joined through the first secure communicationchannel before sending the fabric credentials to the joining device viathe second secure communication channel if the joining device supportsnetwork-assisted fabric pairing.
 3. The method of claim 1, comprising:obtaining local area network credentials from the assisting device forthe local area network on which the assisting device resides; andsending the local area network credentials to the joining device via thesecond secure communication channel.
 4. The method of claim 1,comprising: authenticating to a remote service using accountinformation; and receiving, from the remote service, authenticationcredentials including a fabric authentication token, whereinestablishing the second secure communication channel comprisesestablishing a secure connection with the assisting device using thereceived fabric authentication token and a Certificate AuthenticatedSession Establishment (CASE) protocol.
 5. The method of claim 1,comprising: receive a device identifier for the joining device;determining whether the device identifier is valid; and if the deviceidentifier is not valid, stopping the joining device from beingnetwork-assisted fabric paired.
 6. The method of claim 5, whereinreceiving the device identifier comprises receiving a code located onthe joining device, and wherein determining whether the deviceidentifier is valid comprises: determining whether the device identifiercomprises a valid check digit; or determining whether the deviceidentifier comprises a value expected for the device identifier.
 7. Themethod of claim 6, wherein determining whether the joining devicesupports network-assisted fabric pairing comprises: receiving anindication of a device type for the joining device; determining whetherthe device type supports network-assisted fabric-pairing; receiving anindication of a software version running on the joining device; anddetermining whether the software version supports network-assistedfabric pairing.
 8. The method of claim 7, wherein receiving anindication of the device type for the joining device comprises:receiving an explicit selection of a device type for the joining device;or determining a device type for the joining device from the deviceidentifier of the joining device.
 9. The method of claim 7, wherein thelocal area network comprises an 802.15.4 network, and the establishingthe first secure communication channel comprises establishing aconnection via an 802.11 network, and wherein the second securecommunication channel comprises a secure tunnel that enablescommunication to the joining device via the assisting device through thefirst secure communication channel.
 10. A non-transitory,computer-readable medium storing instructions, which when executed, areconfigured to cause a processor to: receive an indication to add ajoining device to a fabric; connect to an assisting device through afirst local area network, wherein the assisting device is configured toassist the joining device in joining to a fabric on which the assistingdevice resides; instruct the assisting device to connect to the joiningdevice and to assist the joining device in joining the fabric byenabling a tunneled connection to the joining device; securelyconnecting to the joining device through the assisting device using thetunneled connection, wherein the connection to the joining devicecomprises a first portion to the assisting device that passes throughthe first local area network and a second portion between the assistingdevice and the joining device via a second local area network; and sendfabric credentials for the fabric to be joined by the joining device viathe tunneled connection.
 11. The non-transitory, computer-readablemedium of claim 10, wherein the instructions are configured to cause theprocessor to: determine if the fabric exists; if the fabric does notexist cancel the fabric joining and send an indication of failure ofjoining a fabric by indicating that a fabric is to be created; and ifthe fabric exists, select an appropriate assisting device to assist injoining the joining device to the fabric.
 12. The non-transitory,computer-readable medium of claim 11, wherein selecting the appropriateassisting device comprises: determining if any potential assistingdevices are not sleepy devices, wherein sleepy devices periodicallyenter a low power state, and potential assisting devices are deviceswhich have the capability of serving as an assisting device in joiningthe joining device to the fabric; and if any potential assisting devicesare not sleepy devices, using a not sleepy device of the not sleepydevices as the assisting device.
 13. The non-transitory,computer-readable medium of claim 12, wherein selecting the appropriateassisting device comprises: if all the potential assisting devices aresleepy devices, determining if any of the potential assisting devicesmay be remotely awoken from the low-power state; if any of the potentialassisting devices may be remotely awoken from the low-power state, usinga remotely-awakeable potential assisting device as the assisting devicein joining the joining device to the fabric; if none of the potentialassisting devices may be remotely awoken, instructing manual wakening ofany assisting device of the potential assisting devices.
 14. Thenon-transitory, computer-readable medium of claim 10, wherein theinstructions are configured to cause the processor to obtain the fabriccredentials from the assisting device for the fabric to be joinedthrough the first local area network, and wherein the first local areanetwork comprises an 802.15.4 network and the second local area networkcomprises an 802.11 network.
 15. The non-transitory, computer-readablemedium of claim 14, wherein the instructions are configured to cause theprocessor to: instruct the assisting device to cause the first localarea network to place the second local area network into a joinablemode; and instruct the assisting device to monitor for connections viaan unsecured port on the second local area network.
 16. Thenon-transitory, computer-readable medium of claim 15, wherein theinstructions are configured to cause the processor to: before securelyconnecting to the joining device, cause the joining device to beawakened by instructing a user to manually awaken the joining device;and authenticating the joining device using a pairing code thatcorresponds to the device identifier.
 17. The non-transitory,computer-readable medium of claim 10, wherein the instructions areconfigured to cause the processor to: determine if the joining devicehas capability to join the first local area network; after securelyconnecting to the joining device, send credentials for the first localarea network; and if receiving a notice of failure to join from thejoining device, resending the credentials or sending another set ofcredentials to the joining device.
 18. An electronic device comprising:a first network interface configured to couple to a first local areanetwork having a first local area network type; a second networkinterface configured to couple to a second local area network having asecond local area network type; memory; a processor configured to:establish a first connection with a commissioning device over the firstlocal area network, wherein the commissioning device is configured tomanage joining of devices to a fabric on which the electronic deviceresides; receive instructions from the commissioning device to assist injoining a joining device to the fabric; connect to the joining devicevia the second local area network; and facilitate a secure tunnelbetween the joining device and the commissioning device through whichfabric credentials are sent to enable the joining device to join thefabric.
 19. The electronic device of claim 18, wherein connecting to thejoining device comprises: enabling the first local area network to bejoinable; and monitor for communications through an unsecured port onthe first network interface, wherein the first local area network typecomprises 802.15.4.
 20. The electronic device of claim 19, whereinfacilitating the secure tunnel comprises: receiving a first set ofcommunications from the commissioning device via the first local areanetwork and forwarding the first set of communications to the joiningdevice via the second local area network; receiving a second set ofcommunications from the joining device via the second local area networkand forwarding the second set of communications to the commissioningdevice via the first local area network, wherein the first and secondset of communications are encrypted using session keys negotiatedbetween the commissioning device and the joining device.